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During] thre 1976-77 school year, all secofid-grade pupils (299,258) and third- 
grade ^upiLs (284,712) in Californi^f ublic schools were tested in reading 
achievement. All pupils in grade^s^ix (310,843) and- grade, twelve <243,137) 
wei;e tested in the basic skills of reading, written expression, spelling,' and 
mathematics.*' * ' . • • * 
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Grades Two and Three Results 




Reading! achievement test scores for\second- and third-grade 'pupils have been 
improving steadily since statewide testing in Jhose grades began in 1966. This 
trend he s continued through 1977. Table 1 shows that the overall gain of 
second-^ rade pupils was .7 percent correct and that the overall gain of ptipils 
in. grade three was .3*perpent correct. Thes.e gains reflect pupil ^ per {ormajice 
on the California Assessment Program Reading Test , which vas constructed speci- 
fically to assess the broad range of reading programs' in Calif6rnia's public 
schools. . ' . - * ^ 

SpecLal eqojaVing studies were , conducted to determine, the r-elat ionjship pf the 
performc^ce of Califor^iia pupils to the 1973 (the latest year* frxxh which com- 
parable figures are 'available) performance of a sample of pupils across the 
national The median »second- -and third-grade pupils in California were deteripined 
to»be a| the"~55th 'and 56th fiercentile ranks, respectively. In 1975-76 the • 
me'dian sec ond-aarid' third- gi;ade pupils were at the 54th and 55th percentile ranks, 
respectively^ ' » . ^ ; - ^- # ' 



Grade Six P/esults 
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All stidents in grade six took the Survey of Basic Skills: Grade 6 , another 
test de veloped (in ' 1974-7/5) specifically for the California Assessment Progi:am, 
Tabl^e shows that the scores of California sixth-^^rade student's improved in 
written express ion\and mathematics, declined slightly in reading, and remained 
the same in spelling* The gain in 'written expre$sion (1.1 percent correct) ' ' 
was .q^uLte subs t'antial , while the gain iji mathematics (.3 percent correct) and 
the loss in reading (.2 percent correct) were somewhat less so. 

The rejsultstof an equating study provided a'basis for comparing California . 
students with a national sample of students teisted in 1973, the most recent 
year f rom* which* national riorms were available. 6. The median sixth-grade. stuSent 
in California is now above the 1973 national median in all areas. In .fading 
the median sixth *grader in California remained at the 53rd percentilel^ The 
median sixth-grade student moved from -the 49th ta the 51st percentile^tank in 
writte 1 expression and from the 50th to the 51st percentile rank in mathematics, 



2 ' Student Achievement in Ca^lifornia Svhools 

Grade Twell;e Results 

All students in grade twelve took the same test that was administered in 1975- 
76--the Survey of Basic Skills: Grade 12 . Table 1 Shows that, the scores in , all 
four content' areas declined dn 1976-77. (This resu it follqws an increase in 
1975-76.) The greatest decliae was in spelling, the smallest in written 'expres- 
sion. . ' 

Equating studies conducted in 1974-75 provided a basis for comparing th% per- 
formance of California twelfth graders with that of 'national norm "^samples 
tested in 1962 and 1970. On the basis'of the' 1962 norms, the median twelfth- 
grade student in California in 1976-77 was at the 42hd percentile rank in • ^ 
.reading, the 53rd percentile rank in .written expression, and the 43rd percentile 
•rank in mathematics. These ranks represent a one percentile depline since 
'1975-76.' Comparisons with'two other teats with 1970 norms placed California 
twelfth-grade students even lower: at the 33rd and 36th percentiles in reading; 
at ' the 26th and 28th percentiles in written expression; and at .the ^st.and 
43rd percentiles in mathematics. 



Subgroup Analyses 

Statewide test performance was analyzed separately "^for several different^ sub- 
groups of. pupils, schools, and ^di^tricts . A summary of the main findings is 
pres^ted beloW .(but see note"£ollowing^) . ^-^^^^^ , 

1. . Girls scored higher than boys in reading, and boys scored higher 

tha-n girls in, mathematics. These * patterns were basically the 
same in 1975-76. ^ . . * 

2. There was a fairly direct relationship between .-test scores ^nd 
parental occupational level: The higher the parent's occupational 
level, as defined chiefly by the amount of education required 

for the parent's occupation, the higher the student's test scores. 
Furthermore, the schools with the greatest {Troportipnsof high- 
scoping students made the most- progress over the prevA)us y^ar. 

3. Schools with ^a high proportion of students from homes receiving- ' 
Aid to Families with Dependent Children . (AFDC) scored lower ' 

; than the other schools did. Additionally, schools with^lhigh 
proportions of students from AFDC families made less progress 
than schools with low proportions of such students. 

m 

4. As a group, pupils who^ spoke Japanese or Chinese in addition to 
fluent English scored highest of all; pupils who spoke only^ 
English scored nearly as high. The students Who spoke limited 
English and 'another language scored substantially lov^er than 
these groups and made the least' progress in 1976-77. 



Within the two categories df ^'fluent Englj?sh and another language" 
and "limited English and* another language," those students wh6se 
other language was Spaijish scored substantially lower than those 
whose other language was other than Spanish^ Futther, a greater 



Table 1 / . * 

Number of Students Tested and Average Percent of Qaestioas Answered ' ^ 
Correctly by Grade Lfevel and Content Area for 1975-76^^d '1976-77 



Grade level and 
^ content area 


Number 
tested 


Average pep<5ent of questions 
answered corrrectljv" 


1975-76 


1976-77 . 


Difference' 


Grade 2 Reading 


299,258 


67.7 


68.4 


+ .7 


^Grade 3 Reading 


.'284, 712 


81.4 


. 81.7 


+ .3 


Grade 6 , " 


310,843 


■ 




• 


Reading 


■ 


66. 1 


65. 9 , 


- .2. 


Written Expreasion 




62. 5 


■ 63.6 


+1.1 


Spelling 




63.6 


63.6 ' 


- -0- 


Mathematics 


1 • J. ' 


.57.4 


. 57.7 , ■ 


+,3 ^ 


Grade 12 


243 , L37* 






• if 


Reading c 




■ 64. L,' 


63.6 


- .5 


Written' Expression 




62.3 


61.9 


- .4 


Spelling 




68.0' ■ 


6 6.. '8 


^ -1..2 

f 


Mathematics » 




, ' 67.0 


66.3" . 


- .7 

1 , 



student' Achievement in California Schools 

proportion of ^11 students were coded in these categories in' 
1976-77, especially in. the limited-English-speaUing category. 

The schools that had high scores in 1975-76 mad^ greater .gains 
in 1976-77 than the schools that* had low scores in 1975-76. 

Pupil mobility in the lower gracfes^ increased from 1975-76 to 
1976-77. Although- the more mol>ile students sc^pred lower than 
the more stable pupils, the more mobile students made slig^htly 
grfeate'i- progress in 1976-77.. * ' ' ' . 

^7. The students in-uniffed distric*?s tended to score lower and 
made smaller gains 'than those in elementary or high school 
".<^s t^ricts. It should be noted that the sttydent populations , of 
j&nified districts included a large proportion of disadvantaged 
Students living in the most highly ^populated cities in California. 

''8. Small schools usually^scored higher than large schools and made 
more 'progress^ from 1975-76 to 1976-77. Correspondingly, t\ie 
•largest schools scoredvthe lowest and re^stered the smallest' 
, • gains, espe^cially at ther^elementary level*. Again, these pat- 
terns probably reflect the types of students enrolled more 
than 'the effect .of si2e--that is, ^ very large schools had the 
greatest pr6po.rti.on of students from AFDC families and students 
•who spoke Timited English. 

Caution : The findings in this section are highly susceptible of 
misinterpretation./ They simply describe the achievement patterns 
of California students and schools; they do not contain an explana- 
tion of the causes of the patterns or how they might be changed. 
Simple and apparently obviogs conclusions are likely to be wrong, 
since the findings usually are presented for only one factor at a 
time, and, as always,, the" achievement p^terns result from combi- 
nations of many factors. For example, one might concl'ude from the ' 
data in this report that school size is a major determiner of m 
pupil achievement levels. A combination of factors, however, such 
as the social and economic background of pupils' families^ appears 
instead more nearly to account for most of the test score dif- 
ferences am'ong schoqls of ^different siz^s. la fact, school size 
^ apparently just happens generally to correlate with these other, 
^ more significant f actors--and the same is triie fot certain 'other 

individual factors, such as pupil mobility and school district 
♦organizational structure. 

r- * 

The major portion of this report is devoted to an^acialysis of the specific 
findings for each subject area. ' Example test questions are presented to il- 
lustrate the relative' strengths and weaknesses of California students. The 
discussi(yn of tesults for' eac1i content area is based fieavily on the comments 
of recognized author ities , who reviewed the findings. and pointed out implica- 
tions for the improvement of CaMfornia school programs. 



11. Introduction. to the Report 



Tliis re^drt presents the resylts for the third full year of?-the California 
Assessment Program. The reader';^ attention is "called to several features of 
the report which have already become traditional. " T 

• Detailed Findings . Information is presented not only for 't;he m^or 
content areas of reading, written expression, and fnathenlaticfs Wt a^so < 
for a variety of sjcill areas within each major are^. 

• National Comparisons . , Although tests were^4eveloped speeifically to 

- correspond to the ski.lls and excepts being^ ,taught in California schools 
specia^l studies have been conducted to_ show How the performance of, v 
5 California students compares With that 6f recently tested samples 
'o-f students from throughout the nation*. \ ' * 

* • Expert Opinions . Recognized authorities' in each professional field' ' 

ha^^e^ presented thfeir interpretations of the* results for ' each of the con- 
- , tent areas by identifying areas of relatively " satisfactory performance 

and areas* that^ nefed attention. . Test questions and scores are given in / 
t the ai5pendixes to illustrate the' mture and range of skills mastered 

Jby California students. 

Sevetal special features of the 1976-77 report are also worth noting. 

- ' ^ ' ' f 

More Examples . Severa,^readers' have; comr^entiied «ipon the value^dC^^, 

seeing actual test items and the way Califorfiiaf students responded* 

to those .items. * A greater number and vari^ety of these examples are ^ > 

^' presented this year. * * . ' * ' 

• New National Comparisons . combination of 'new equating studies 
and refinements of the equa-ting procedures have made it possible to 
present the current performance of Callforni5L^ students in relation 

^ - to .the most eurrent national norm6. * s ' ' ' 

• Comparable. Results . The development and refining of the tests used in 
the California Assessment Program have reached the point wh^re they 
can t>e used without revision for a period of years. All results in* 
this report are cbmparable to those of 1975-7^ • . ^ / ' 

• Subgroup Analysis . - With the starbility of the tes<ta it has become ' " 
■ possible and appropriate to examine #the differences , in standing' and 

' in rate of progress am(5ng various subgroups g^f -pupils and vatious types 
of schools and districts. - , ' 
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6^- , ' Student Achievement in California ^hools 

^Development of the California Assessment program ' 4' •/ 

' ^ ' r ' : , . 

The California Assessment Program was first frilly implemented in 197^-75. .In 
design, develppment, and procedures, It is unique in. the nation. The'",^sS(essment 
program was designed with several criteria in mind: ('1) It* raust'be relevant 
to California .schools; (2).- It mu^t cover the full rang^ of instructional objec- 
tives;' (3) It, must, provide program-diagnostic information at th^ local and state 
'levels; and (4) Itr pnust* take only a minimum of testing time.' :1ti£s section 
describes the process of de^el^ping such a*'program, ' , ^ 

=\ • ' " ' ■ ' ■ . ' 

^^.c_kg^o^nd> and Assumptions . ^ » ' ' ^ ' * 

The^new assessment program had its foundation' in two legislative acts: (1-) the 
California School Testing Act of 1969, a^.revision of a 1961 law which first re- 
quired an achievement testi'ng program in the public schools; and (2) the Miller- 
Unruh Basic «^^ading Act, which originally required reading tests in grades one, 
two, and three^ The testing program was revised by 1972 legislation, and maj-or 
changes were made in the program as a result of that legislation. * \^ 

•The changes in the statewide' testings program, were based on the principle that 
an efficient state testing program has to be limited in scc|pe — that is, limited 
primarily to the t^sk ,of. f umisljing useful information to dtfete-level policy-' * 
makers and dec^sio^'n-jnakers . It was'assumed that^the prog^am^ could not meet 
all of the man}^ infonrfation needs of local school discrilct personnel and that 
assessment information needed* at the c fa«s room level -p^mld best be /ollect^d ,by ** 
local school personnel. • • i^ ' ,^ * ' . 

:In spite of thi's'assumptiafl^Ke program' was des/gned tb^ripbrt as much i^Uormat ion 
as pos^^le to Icfcal^personhel. Since'all students. at a gtade level inall school's 
were t ested, it was -possible to provide very detailed" an^l-^jtical reports for each 
school to supplement locally ^obtaidj^ied iufo'rmatioli^y * In fact^ the rr^esults of a 
purvey of all districts in California showed that Vnost di.sXiricts have found this \ 
unique inf Drmat'ion very useful in eval^iating atid r^^isingriRgrams. ^ Boai^d members 
and other local cit'lzens have relied heavily, upon sratwW-^results in 'making 
judgments about' Ipc^l needs and acc/Dmplishments primarily beoajr^^*"^ the uniform 

^and .comparable nature of the^informat'l-qn provided. 
*■ , • • • ' 

Reasons for Revising the Testing Program ^ \ . 

Two major problems were addressed thro.ugh^the revision of tlie statewide ti 
program: ' • - ^ ; ^ ... 

• '1- V Tes^, relevancy ai^d br^adth . The ihbomp-lete ifiatCh between the relatively* 
riarro^ range of ^skills measured by any one pub.Hshed standardized t^st^ 
■o^n the* one hand, and the variety^ of instructional progratns i-ACalif ornia 
s(fhools, on t^e other, made it difficult to assess the 'tskills of Galif- 
^ ornria studtents or the effectiveness of the programs^^th any degree pf 
^to«*^a3si>rance of fairhess. Furthermore, ^i,t w^s not po^^PPe'to assess the ^ 
relative strengths and weaknesses of California students in ordef to 
^ ' 'hav^.an indication of how instructional programs "sljould redirected. 




■ " ' , . \ " ' , Introduction ' . T • 

■ !/ • slnoe the standardized teisfcs bejlrig used* yielded only total sqpres.. 

2. Testing* time l Previous testiitg* instruments required an inordinate 
amount of pi|pil time for the testing process — ^inordinate,' at least, 
in relation ;t6 the usefulness of the results. The use of -a new . ^ A 
testing tfechnique^called matrix sampling has now' reduced the amount' 
1 ^ 'of ^testing time at certain grade levels from .as much as ^riee ^nd one- 

I ^ ^ half hours to'"30 minutes. Under thi^S sampling method,, all students at 
, . a^^-'grade level 'in alt schools are; tested, but ^each' student takes only 
^ ' ' ;a portjLoTj of; thfe total test. Results for an individual student cannot 
be obtained, but quit;e^ a'dcu|:ate estimates of the overall performance 
^ of group*^ of , students can be coirtputed.. 

' t ' ' " ' ^ \ / ' 

Development of t|ie New Tiests ^ • ^ - 

The .development of tests related to Calif ottiia *goals and ofcjectivBs followed 
. a rigorous procedure. The major steps are outlined below^ 

V . . . ' / * • ^ 

1. Statewide committees of content area experts were formed and charged 
with the task of translating and delineating^ the general goals found 
in state-adppted curriculum framei^orks. into mor% specific objectives 
appropriate- for assessment. .• * 

2. These specific objective^, or ^est" content specifications, were then 
/reviewed by personnel in all California scfiooL districts for complete- 

^ness* and relevance' to their.^ instructional programs* The revised - 
specifications served as the basic guidelines for selecting dnd 
developing pools of ^test items. These documents were subsequently 
printed and distributed to all school districts under the general 
title Test Content Specifications . ^ ' ^ 

• " • * * - « .. 

3. These content specifications were sent to* major test publishers ^ho ^ 

identified those test questions which matched the specif ications% ' • 
These were submitted to the Department of Education for review.. 
» . •* • 

4. From the initially large pools of items, teams ofvclasaroom teachers 
reviewed and selected the Items that weje most appropriate for 

, California students. ^ ; 

5. These items were then reviewed Tjy linguists and minority group testing 
experts for any subtle biases against students of different: language 

^1 or culnural backgrounds . 

6. The final pools of items, seVeral hundred at each grade level were then 
divided intx) several short tests ot'^f orms — from 10 tQ IS^'p'er grade; level. 
All tes^Attrms were made equivalent in difficulty and in'coverage of, 

y \^ major area's. 
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8 - * Student Achievement in California .Scfiools ^ 

The National* Norm Di lemma . » • ' . • v 

s4?ce .1962, the first year of statewijje testing in California, all^tests adopted 
for use had been commercially published instruments with'' "national" norins. The 
new t^sts ^escribed in this report were constructed specifically for use in 
California schools. The decision to* develop tests rather than use commercial- 
"of f-the-3helf " tests with national norms was' not made , casually . Comparison 

\ to national averages are not only interesting but are useful as a basis *for judging 
the overall. relative effectiveness of California's instructional programs. Fur- 

- thermore^ California law (Education Code sectibns 60663 and 60640) requires that 
such inforTT\ati(^ be made available. • • 

A real dilemma, one w,ith both philosophical and technical aspects, faces anyone 
who would measure the basic skills of California students: to -choose a test 
whjich has national norms but fails to address all the skills taught in California 
schools,', or to develop a relevant test which does not allow 'easy and immediate 
na^tional comparisons. Assessment programs in other states are about e^iually 
divided betweep these two approaches. After eleven years of using 'tests with 
national norms* but less than satisfactory coverage of the skills being taught 
in California schools and after observing the difficulties faced by other states 
in interpreting th,e results from their own tests without nat;ion^l norms the ^cojarse 
to be followed was obvious;* Develop a test which fits the in^'cructional programs 
of iftost California schools and then find a way to compare those results national 
norins . ^ . * , 

A plan which, could ^accomplish this (allow one to have one's cake and eat it too) 
had to overcome two main problems with the national norms associated with published 
standardized tests. ' *^ , 



1. ' No siligle^test is given to all students in the country. ,0f necessity, 

a publisher's norm'is, 'therefore, only an estimate of what the distribution 
of scores would be like if, in fact, the test Bad been taken by all 
students in the Unite3 "States. For this reasonX norms vary from pub-' 
iisher to publisher, sometimes in 'the extreme, m California's own r^ent 
history, the 'StanlEord Reading Test was administered to all second-grade 
pupils' in the 1969-70 school year, and the median Calif,ornia pupil . 
scored at the 38th percentile of that publisher's norms. In the* following 
year the Cooperative Primary ReadTng Test was a<iminister ed to all second- 
grade pupils. The median California pupil scored at the 50th percentile 
. of that publisher's norms. The^^dlf f erent result was clearly a reflection 
more of the difference in norms than cT the difference in reading 'achieve- 
ment. 

2. ,A second problem with nonrrs .is that they are not updated very often. 
* For instance, the Cooperative Primary Reading Test was norme^ during 

the 1965-66 school year. As a result, when those norms are referred to, 
it must be clearly understood that the comparisons being made' are to ^ 
the publisher' s estimate of what scores on that test would have been 
if administered to all pupils in the country at that time. If reading 
scores for the nation had dropped- continuously since 1965-66, an 
"average" score for California pupils might, in fact, ref,lect achieve- 
ment far above cutrent nationwide averages. 
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'K < • , ' ' * 

The resulting plan is straightforward and efficient. It involves the equating 
of the California tests to. standardized tests with Rational norms and updating 
t?hose comparisons as new norms- or new tests become available. The equating process 
requires that a sample of pupils take both the California test and one of the other 
tests. The effect of the statistical analyses fallowing the* testing Is to show 
ho\* talifornia students would have scorned ;Lf they had all taken the standardized 
test. Following recent refinements to the equating procedures, a study now has 
to be conducted only once, but the annual progress on the California test can 
be t|:anslated intp the appropriate na^tional percentile ranks (against the yeao: 
in w{^ic.h t^he publisher's test was normed, or course,^ not against the national 
performance for that year. The latter would be the most useful information> but 
it is simply not obtainable). ^' ' • ' . , 

This solution has several advantages^ (1)^ the national comparJl.sons are more 
timely since they can be updated as new notms become available; (2) the estimates 
are more stable since ^ they do not depend on the representativeness of a single 
publisher's sample; and (3)'*it allows California schools to be, assessed with a 
test which fits the objectives of the instructional program, *and simultaneously, 
with almost no additional testing, allows that performance to be compared to 
national norms. 



Essential Information About the 'Numbers Used in This Report 

,The. Percent Correct Score .' T^^ statistic used in this report to indicate the' 
achievement levels of California pupils is the "average percent correct score." 
For a given set of test questions, this number is the percentage of correct test 
responses, with one resportse being equal to the answer of one student to one 
question, and the total number pf responses being equal to the number of students 
multiplied by the numb'er of items on the test. For example, if three students 
took a test with ten qu^tions and if each of the three answered five of the 
.ten questions correctly, the total number ofSresponses would be 30, the total 
number correct would be 15,^ and the -average percent correct score would be 50. 
It can also be said that the average student answered^SO percent of the questions 
correctly; or that, on the average, 50 percent of the questions were answered cor- 
rectly. 

The avera^ge percent correct score and the simultaneous presentation bf illus trative* 

test questions or exercises are designed to'add to the clarity and^usef ulness of 

the findings. It should be easier, as a result, to see what California students 

are able to do.^ Unfortunately^ this method is so new in educational evaluation 

and assessment thatVguidelines and rule-of-thumb benchmarks ^re not available. 

Each- reader will have to evaluate the -adequacy of the results. The emphasis is- 

on establishing realistic and necessary levels of actual competence rather than 

on the traditional comparing of results to a national norm. 
* 

How High Is High? It will be noted that most of the average percent 'correct 
scores hover around the 60s and 70s; however, some are down in the 30s, and 
some are up in the 90s. Two points must be kept in mind in interpreting these • 
figures: < - \ 



1. The major reason that the average scores are in the. 60s and 70s, 
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rather than the 90s, is that the aims of the instructional programs ' 
at each level in California schools go^ beyond the basic, ^minimal , 
levels of performance expected of all students. In reading, ^or 
example, those skil^jwhich are mastered by most students by the 'end 
of the second grade are not even tested in the sixth 'grade. Testing 
time is too valuable and the scoring and the processing too ^expensive to 
justify gathering information which does not add to what is already 
Joiown about Cal;Lfornia students • ' ' 

I»t should be, obvious that;high scores in particular su^kill areas 

do not necessarily indicate ef f ective* prpgrams; *tior low^scores, ther ^ 

opposite. . Some 1:asks are inherently more 'difficult . In reading, 

for example, it is 'not 'considered outstanding that by the end of 

gjade three, nearly all students ^an iftanediately recbgnize and read' 

certain short words; nor is it at all disappointing that only about 

60 percent can answer certain questions requiring a student to recognize 

cause~and--ef f ect relationships among sentences . . 



Interpretations of Experts . The overall result's and especially the differences 
among various subcontent or skill areas have been reviewed by special advisory 
committees of highly respected educators in 'each field. It is hoped that their 
comments about the adequa^ of the findings and their discussion of the limplications 
for shifts in program emphasis will be helpful both to the professional educator 
and the lay citizen concerhed with education in California.' ' Obviously^ however, 
not all readers will ^ree with the opinions o| the specialists. Any discussion 
or inquiry which is stimulated by these opinions is useful in that it will ^?lp 
to clarify the proper objectives of the schools and foster realistic expectations 
of them. i - • . 
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Ml. Reading Achievehient for Grades Two and Three Z 

. ' ^^'^ 

' .Synopsis of E^lndings - • ^ • ' , . 

Over the last ll'years, reading achievement^ test scores in grades two and three 
have 'Shown slow but steady improvement. . Secondrgrade scores increased slightly 
(.7 percent) from 1975-76 to 1976-77> which translated into a gain of on^ 
percentile point on national ndrms. Thus, the median second-grade pupil moved 
from }:he 54th to the, 55th* percentile rank--five percentile points above the 
national average. Third-grade scores increased ,3 percent from 1975-76 to 1976-77; 
which al3o translated intt> a ga£n of one percentile point on national norms. 
The median third-grade pupil now ranks at the 56th percentile--six percentile, 
points above the national average. See Chapter VIII, "Comparisons with Nat^ional 
Norms,** for details. — ^ V 

Test- Scope '-^ » . , . * 

The Reading Test; Secj^nd and Thiyd Grades is ftie instrument developed specifically 
to assess reading achievement at* the end of the second and third grades in 
California's elementary schools. 'It was designed to assess^ a wide variety^ of 
objectives di3<?hsfted broadly In Framework iti Reading for the Elementary and 
Secondary Schools of California (Sacramento: California State Department of 
Education, 1973) and specified, witli the help of th^ Reading Assessment Advisory 
Committee,, in Test Content Specifications for California State Reading Teats 
(Sacramento, CaTTfomia Sta^ Department of Education, 1975),^ Both the objectives 
ana the 250 test items thai? were used to assess them fall into one of six major ^ 
skill areas: phonetic analysis, structuraT analysis, vocabulary, literal 
comprehension, dnterpretive-critical'"comprehension^ or study- locational . 

Comparison of 1^75-76 and 1976-77 Results, Grades Two and Three 

* 

The results of second-grade performance on "the total reading test and In each 
of the major skill areas for 1974-75, 1975-76, and 1976-77 are shown in Table 2. 
Thus, changes in performance from year to year over this time span are also ♦ 
presented in Table 2. 



The data in this table reveal a slight increase in overall second-grade reading 
performance from 1974-75 to 1975-7 6 (+.1 percent correct) and from 197 5-76 to 
1.976-77 (+*7 percent correct). From^ 1974-75 to 1976-77 there was a total 
increase of .8 percent correct. Skill area scores either increased or remained 
the same from 1974-75 to 1975-76 and from 1975-76 to 1976-77 for all skill 
areas except vocabulary and* literal comprehension. Both of these skill areas 
Registered slight declines from 1974-7^ to 197 5-76, however both registered 
larger increases from 1975-76 to 1976-77 resulting in a total increase of .9 
in both skill areas from 1974-75 to 1976-77. 



Table i 

Grade Two Reading Test 'Results for 1974-75, 1975-76, and 197fr-77 



y 


Number 




Average 




, Gain (+) or losi (r) 


in §core 


Skill area . 


percent correct 


1974-75 to 


1975-76' to 


1974-^75 to 


of 










<Iuestions 


1974-75 


1975-76 


1976-77 


1975-/0 




1976-77 ' 


<^ 




















67.6 


67.7 


, '68.4 


+ '.1 


; ,+ .7'.-- 


4- ft 


Word identification 


60 


75.4 


75.5 




+ ■. 1 


+ . 7 , 


+ '. 8 . 


Sight words-. 


. 5 V. 


8^.9 


84.5 • 


85.4 


+ . 0 


+ . 9 


+1;5 


Phonetic analysis 




76.5 ' 


■ 76.5 


77.1 


. -0- 


+ .6; ■ 


T . 0 


Structural analysis * 


10 ' 


65.8 


66. 3 


67.5 


+ .5 


. +1.2 


• +1.7 


yJcabulary 


60 


67.7 


.67.6'". 

• 


-< 

68.6 


\ - -1 - 
1 f 


0 


. + ."9 


Comprehension 


110 


• V 
61.\3 


61.3 


62.4 


-0- 


- +1.1 


+1.1 


Literal 


- 77' 


62.5 


62.3 


63.4 


- .2 


' +r.i- 


+ -9 , 


Interpretive 


33 


\ 

58.7 


59.1 


60.0 


+ .4 


+ .9 


■ . 1 

+1.3 


Study locational 


20 

V 


75.5 


77.2 


77.9 


+1.7 


+ .7 


+2.4 


• 






^ - IB 

f 






















4 




: i 

1 
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Table 3 



• Grade Three Reading Test Results for 1974-75, 1975-76, and 1976-77 



Skill area 



Number 
of * 
questions 



Average 
percent correct 



1974-75 



11975-76 



1976-77 



Gain or los? (-) ii\ score 



1974-75 to 
1975-76V 



1975-76 to 
197^^ 



l/74t75 to 
1976-77 \ 



TOTAL . - 

Word identification 
Sight words . . 
Phonetic analysis • 
Structural analysis 
Vocabulary 
Comprehension 
Literal 
Interpretive 
Study locat^nal 



25Q, 

60 
5 

45 

10 

60 
110 

77 

33 

20 



81/3 

85.8' 

92.7 

86.1 

80.9 

82.6 

77v0 

77.9 

74.9 

88.0 



81.4 

85.6 

92.6 

85. 

80:8 

V 

82.9 
76.7 
77.5 . 
74.9 
88,0 



81.7 
•85.-9 

n.9. 

81.' 1 
83.4 
77.1 
78.0 
75,0 
88.8 



+ .1 
■: .2' 

- .1 

- .2 

- .1 
.+ .3 

- .3 

- .4 
. -0- 

-0- 



♦ + -.3 

+ '.3 
.3 

+ .3 

+ ,3 
'+ .5 ' 

+ .4 

+ .5- 

+ .8- 



+ .4, 
+ .1 
+ .2 
+ .1 
+ .2 
+ .8 

+ ;i 

+ .1 
+ .1 
+ .8 



f 



tl9 



< 
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' The results** of th^rd'grade* performance" on the totlal ^reading test and in eacIT . 

• , of the-Wjor skijLi areas for 5^'l975-76, and 1976-77 are shown in Table 3. 

Thus, as'vwas' the case* for grade twb^ changes in performance from year to year 
over this time sp^n* are also iratoediately apparent from the CaBIe/ T • 

* r ' ^ " ' \ ^ * 
As is evident fi;am' Table 3^ therfeS^as a slight increase in overall third-grade 
reading performance fr:om 1974>75Tt<x 1975^76 percent) and from 1975r76 to,. 
1976-77 (..3Apfercent) , ^yielding a tatal increaSe of +.4 percent correct from' 
1974-75 to .1^76-77. J^ot»'1974-75 to 1975-76 slight declines were registered in 

, all of the skilly areas ^xfcept for vocabulary, in which the percent correct score 
^increased slightly (,3 percent), and interpretive comprehension anfl'study-| 
locationSl .skillrs^' in >nicn the scores remained the same. .From 1975-76 t/b 
1976-77 increases were registered in all of the>skill areas, which resulted 
in total gains in aXT'of the skill a^eas from 1974-75 to 1976-77. 



Discussion and Analysis of Reading Test Results, Grades Two and Three 

The members of the Reading Assessment Advisory Committee have consistently ; 
asserted that the ultimate aim of all reading instruction is comprehension;^ 
that is, the ability of pupils to understand writte^n njaterial. However, compre- 
hension depends upon the mastery o^ many interrelated s-kills. Therefore, the 
following discussion illustrates some of the skills that second- and third- ^ 
grade pupiis have and have not mastered. The reader may wish to refer to' 
Appendix A for additional information and examples pertaining to ^ach of the 
skill areas/ 
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Phonetic^^Analysis 



Forty-five of the 250 questions qn tlie second- and third-grade Reading Test 
required the pupils to match sounas with letters or with combinations of letters. 
Since the initial phases of reading instruction usually focus upon such sound- 
symbol correspondences, one would expect scores In this area to be among the 
highest on the test. The skill area score data in Tables/ 2 and 3 .reveal 
that this is, in fact, the case for both grade two (77/l\percent' correct) ^4 
grade three (86.2 percent correct). While the scores on most phonetic analysis 
questions were generally high, the range of the scorcsB 'was* ''nevertheless, quite 
broad — from a high of 98^^erc€<lftt correct to a low of 49 percent correct.. For 

- example, almost all secoM- and third-graders demonstrated mastery on questions 
that required them to jnatch pictures with initial consonants, as is illustrated 

^y Example A. ' 



Example A ^ 



Look at Boy 5. * * * * M.jrH the one that goes 
best with the piiCture. * * * * Mark the one that 
goes best with the picture. 




d 


k 




P 


; O , 


• 


Grade 2 t ( 2) ' 


( 2-) 


(96)- 


Grade 3.: ( I) 


■ ( 1) 


(98) 


\ 


20^ 





0 ' ' 

Reading Results, Grades Two and Three^^ 
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The task ih Example A required the^^pujjils to identify the» word represented 
by the 'pici^^^e to match the word with i^s beginning letter (in^this case, 
the consonant **h"); Th^ item data indicate that by the ^nd of third gr^de, 



,S<>me phonetio analysis questions, however, ^were more difficult thap that^showhf 

in Example A* > For instance," ten items required th^ pupils tt) match a ^l\ort^-'o 

vowel sound (pronounced 'by a teacher) "with its^ corresponding letter in .arthfee- 

letter word. The task in Example B is illustrative^f this t^pe of item. 



Example B 









Uook.at Box 1. *** 


• Mark the 


word that has ' 


the same sound' ir 


il5 'middl( 


3 as' cut. . ■ 


Mark the word^hat 


has the same sound jn its 


middle *a3 cut. 

e > 






fun- 


fill 


mil " 




C) 


( ) 


Grade 2: (84) 


• ( 9) 


\ ( 7). 


Gradfe 3:« (91) 


( 5) 


( 4) 









Items like Example B were more complex than those like Example A because (1) they; 
involved words rather than a single letter; and (2) vowels, -(which vary co^iderably 
in sound from word to word) were being tested rather than "Consonants (which as 
a rule tend to be more consistent in sound from word to wor8). 'As^ the .item 
data= reveal, about 84 pet*cent of the second graders and abmit 91 percents, of ^ 
th^ third graders performed successfully on questions of this ^ type. ^ ^ ^ 

The ten items that required pupils to discriminate between different soundi^of 
the same vowel were even more difficut^t. Example C is such an dtem. ^ 



Example C 



ok at Box. 2. 



Mark Ihp worc^ tliat has ^ 



the same sound in it§ middle as like. * * * * 
Mark the word that has-thesame sound in its 
middle as like. 



r ipp • 

Grade 2: IT2) 
Grade 3: (80) 



( 5) 
( 2) 



rich 

( ^ 

(23) 
■"(18) 



( 
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.The type of item in Exanple (^tested pupils* mastery of a ^more advanced phonetic 
skill in the context of slightly^ longer words. The increased degree^ of difficulty 
was reflect^ed by still lower percent correct scenes as shpvn in the item data 

— (72 p e rc e nt co ^^^e ^ for gra d e two; 80 percent correct for gra d e thre e ) for — 

"Example C. • . ' . . ' = . . 



Structural Analysis <^ . . ' « . \ ^ 

While the phonetic analysis questions 'on the Reading Test assessed the pupils* 
awareness of sound-letter correspondences, the structural analysis^'items tested 
their kui)i^1a|4ge. of word parts, such as roots,* suffixes, prefixes, contractions, 
and the elenfeuts of compound Words. As was true of the phonetic analysis skill 
area, some struc\yral analysis questions wer^^more difficult than others. 
For example, a n^jority of second- and tjiird-graders- correctly identified the 
'following contraction in Example D. » , ' - ' 



Exampl^ D 



Look at Box 6. **** Mark the word* ths^t 
means the same, as the word that;^3 under- 
hned. **** Mark the .vyord that meags the 
same as the w-ord that is underlined. 



that's J 

that IS that is not 



Grade 2: (85) 
''Grade 3: (93) 



(10) 
( 3) 



that was 

. ( 5) 
( 4) 



9 



However, not .'as many pupils at either grad^e level recognized the corteQt 
division of a compound word into its component parts, 'as is illus'trated^'by 
Example E. , • ^' ^ ' ' . 



Example E 


$ 




upstairs 


ji 


1 — 






ups 


1 ta'irs 


'\^)bt » airs 


up t stairb 


• 




O 






• 


Grade 


2: 


(22) 


(13) ' 


. (65) 




Grade 


3: 


(14) 


( 4) 


. • (82) ' 



Reading Results, 'Grades Two and Three 
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After reviewing second- and thii;d-grade scores on th^- slirucfeural analysis 
questions, -members of ^he Reading Assessment Advisory' Committee judged that I 
^cores should be still higher in this skill area since the cluster of. structural 

? building block df reading comprehension. 



Vocabulary ^ . 

The 60 vocabulary questions required the pupils to identify the meanings of 
words in a variety of formats* - This ability to rd^cognize, word meanings is 
anot];ier fundamental building block of literal comprehension. The difficulty 
of the vocabulary questions ' appeared to depend upon the difficulty of the test 
word and the testing 'format used* For example, 75 percent of the second-graders 
a^d '90 percent fcrf^ the third-graders demonstrated an understanding of the word 
V'small" in the f(^lowJng item. 



Example F 
\ 



Look at Box 9. Mark fhe word that 

means the safne as the^word that is under-' 

Imed Mark the word that means the 

same as the^word tKat is underlined 

ir 

- . V 
* a small cake ^ 





pink 


b?rthday . 




. little 


« 


o 


O 




• 


Grade 


2: ( 3) 




. ( 5) 


(75) 


Grade 


3: ( 1) 




( 3) • 


(90) 




f 


9* 







HoweiMer, fewer- pupils identified the" meaning of the more difficult word^ ^^bashful" 
.in Example G. * y ' • . 



Example G ^ 



a bashful boy 



brave 



shy 



Grade 2-7 (30) (56) 
Grade 3: (16) (75)- 



nnw noisy 

. o ■ 

( .6-) ( 8) 
.(4) (5) 

4 



Ten of the^ vocabulary questions tested the pupils^ understanding of* antonyms. 
A Question of* this type is given in Example H. ^ ^ 
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Example. H 



Look at Box 12. **** Mark the word that 
means the opposite of tho word that is 
aipdet I iDed>-l*J-LMark IJtifi^WiirdJLb^Jjn^^^^^ 



the opposite of (he word that is underhn^d 



, begin 

ond 

Grade 2:. (61) 
Grade 3: (75) 



( ^ - 
Xis) 



stnti 

(24) 
(19) 



Questions such as that in Example H required the pupils not onl^ to Identify 
t^e meaning df the test word but also to determine a word opposite in meaning 
from it. I^lje extra complexity of the task may be the reason that the percent; 
correct *score on such an easy word is so close to the score on* the more difficult 
• vocabulary item in Example G, , ^ ^ 

Several vocabulary items were tested in still another format. On ^hese items ^ 
thejupils were <arequired to select a word for a given blank in a sentence. 
^^^Ixampre "I illustrates this kind, of vocabulary question. 



Example I 



We are 



<*Grade 
Grade 



g^g 



to have. 



.for supper. 











dish 


until 


soup 


stones 


o ■ . 


O 


• 


O 


(10) 


( 5) 


(77) 


( 8) 


( 4) - 


( 2) ■ 


(89) 


( 5) 



L iteral Comprehension • . ' ' 

— • , ^ 

While the phonetic analysis, structural analysis, arid vocabulary questions/^ 
fpcused upon sound-letter correspondences, pafts of words, and word meanings,' 
the 77 lateral comprehension items required t]ie pupils *to iflentify explicitly < 
stated elements in larger units of material, such as sentences arfd par^'raphs. 
Given the increase in skill complexity, it is logical to expect lower ^average 
percent correct scores for this area than for the less complect ski].l areas 
already discussed. The data in Tables 2 and 3 confirm this expectation with 
an ayexM^ge percent correct score of 63»4 in the second grade and 78.0 in the 
third grade. . " ^ 
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^However, withfn the skill area of literal comprefiension, the 'test questions VsCried 
considei:ably ir\ complexity. Consider, for instance, the question in Exampla/j,.. 

'J . * 

Ex a mple- J- ^ ' p — ~ — — 



Read the story and answer the* questions. 



Bonnie IS 3 spaniel dog, . ' ' f 

She likes \o go1a the water. 7 • • 

She rolls in puddles and tries to get .into the children's plastic wading pool. 
At the beach She likes to have sticks thrown into the water; 
Then she can run out and get thern. 



Grade 2 Grade 3 



(14) 
(75) 
(11) 



( 7) 
(88) 
(-5) 



She rolls in 

O pools, 
#puddles. 

Qthe ocean 



All of the information that the pupils needed to auswer the above question i3«^ 
contai^ned verbatim in the third sentence of'the passage (underlined iier,e-for 
^ the reader's convenience). Since/ t;l;ie "^item is a rote literal comprehension item 
involving a perceptual match ^betWeen words in Jthe item stem and .wprds 'in the 
passage, the high pe-rcent cc^rrect scores were not surprising, \ 

' The literal coipprehension Question in Example K.was more difficult tl;ian that in 
Example J,y . 



Example K 

t — ; 



Read the Story and ariswer the qyestions. ^ ^ ' - - 

r Did you ever see a mouse that could* fly? A bat is 'somejim'es called a flying mouse, 
A bat Is a furry animal. It has no feathers. Instead, its wings are mad? from skin. The 

skin stretches from the tips af its front legs to the tips of its baifk legs. 

Some bats arenas tiny as mice. Others can spread their wings nearly as wide as an 

eagle can, ' ^ * ' ' * ^ 

A bat is not like fivino fish or flying squirrels. Those'ahimals glide only a little way. • 

But a baris like birds and^ome insects. It can stay up in the.air as long.as.it wants to. 
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ExampLe K (con£.) 

' Flying squirrelVcan . : 
Grade 2 Grade 3 . ^ ' ' 

(W) ^( 15) ghdp.-aS' jnrrg' ajrthey want . 



(49) (64), ^ '^•glide only a'little way. ^ ( 

tZO) (11) Ofly like hirds ^* *^ 

. (13i)'' (10) . Ofly like 



answer the question in Exari^e K, th?*pupils had to put together two .sentences 
(underlined here for the reacj^r^s, convenience) , a 4)rpcess which involved* re cog- 
n^ing that **those anitrials'* refers back to' "flying fish^* and »*flying squirrels;'* 
Only 49 percent of the , second-graders and 64 percent of .the third -grader^ % 
managed the task successfully. f 

Other literal comprehension questions required th^pupils to identify action 
sequences from the seht^nce ordfer of a stary. Exarofele L reveals that this 
type of item was also difficult for many second- anH third-graders. ^ 

Example L' > ^ . \ ^ ^ ' '/ - K ^ • ^ ^ 



Read the story and an^wer^thr questions. <JP " f'^^^ ^ \ ^ 

^ My mother. has many friends. TTiey always sa\^o me, "Why, Davie, how * 
you've grown!" . . • ^ 

I decided to play a trick'on them. - '-—^^^ ^ ' 

One day these women were at our hogse, I weht and^safcl tiello \o them. Then I rushed 
, out before they^iild say a word. , . 

I went tp my little brother. I dressed hiq^jn my sljjrt and pants. Then he went to see 
. my^mothor's ffiends. - * / 

^ "Why, Davie, how you've ..." ,1 

They stopped. I had not grown; I had gotten smaller. They were fooled. And th'e^ 
never said it again., ' 



\ 



Which'happened first? 
Grade 2 Grade 3 ^ , ' ^ . v ^ 

,(5lr5 * (69) # Oavie-^ecided to fool the women. 

(20) ' '(15) • . O Davie gave liisJ)rother his clothes: 

(15) / (9) O The. women never said it agarn. • 

(14) - ( 7) 0 The women were footed. 
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After reviewrtfig/^the performance of the second- and third-grade pupils on the 
llterifl comprehension questions, the members of the Reading Assessment Advisory 
Coimnlfctee Qoncij^dedtthat the performance of both second- and third-graders 
was adequate In this skill area. ' ^-^^ 

Int^pretive-Crltlcal Comprehension . ' * 

The 33l interpretive-critical ifompreh^nsion questions required the pupils to 
make . Inferences from explicit elements in *a passage. The increased difficulty 
of t*h^ q4j|stions in»this skill area was reflected^ in the low average percent' 
correct scores (60.0 -percent) for the categ<iry. As was true of the literal 
comprehension- questions,. s6me interpretive-critical comprehension questions 
were easier than others for the pupils. Example M illdstrates one of the easier 
interpretive-critical ^es.tions. r /' \ ^ 



Read the story and answer the w 



estions. 



^Opce there wa§^ httle^bcty who had a^big problem. Every tirno the boy tried to talk 
his wqrds^came out backwards. *No one cpuld urrdeistarid what^he was saying^ 

The little boy'a parents took him to tlie-best doctor's in the,cou?ity. The doctors could 
find no way to help theJittle &ay. ' . * ^ 

'One nighrthe little boy )3ad,a dream.. He c||peamed that if he wilked backwards people 
woOld under^t^nd wH^t he^wa^ sayiag. * ' " ' . 

When he awoke tiieTtext monning he decided to see if his dream would come true. 
He walked'tiackward to the'kitchenr'He spoke to his'mother and father. Gu?ss what? 
Thev could, understand himJ / ^ ^ \ 



Grade 2^ '-- Grkde 3- ^ probablyTelt^ 

(71) . (84) " ' ^ happy. ^ 

(1^) i J) ' . O unhappy. 

( 4) , ( 3) -O angry,, 

(10) i 6)\ c 'Osad. 



At the ^ipl^of the *«itory the^'littte boy 



jCo answeir th^ above'question correctly, the pupils had to (1) comprehend the 
story ;^jand _(2) infef^ fiofw the outcome of tjhe events would make the little boy 
feel. Thus^^'he item was a discriminating test of* their overall cojnprehenslon' 
.of the paTs^ige. As t:he item'data reveal, 7i percent of the second-graders arid 
84 percent of the third-graders handled this question successfully* 
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Whll^ over two-thirds of both the, second- and third-grade pupils correctly 
answered the question' in. Example fewer students successfully iiandled a 
similar item in Example N« 



Example N 



Read the story and answer the questions. 



Ben and Billy climbed down a rope \nio the cave. It was cold and dark, damp 
and quiet. * , ^ ^ ^ - ' ^ 

"Swell house for a ghost," Ben whispered. He sKiinecj the flashlight afl around. 

The room was filled with rocks. There were pink ones and green ones, and^ • 
other colors- too. Some,of the rocks were bigger than the boys, but some;were the size 
of potatoes. ^ ' ^ * . - y 

All of,d sudden, something soft and wet dropped on Bei-Kis heacl. "What's th\t?" 
asked Billy. : . • ' - ] 

"Let'^s get out of here fast," Ben shouted. But as fie started to run, he dropped the 
flashlight. It smashed on the cave floor.-Now they couldn't see^ anything at all. 



€rade 2 Grade 3 
(22) ' - (15} . O hopeful. 

(18) ^ (14) Ocalm. 
(8) < 5) , O^oud. 

(52)^^:?*^ (66) * • helpless. 



After the flashlight dropped, 
Ben probably felt 



The lower percent correct scores on the- Question in Example N probably reflect 
a greater ^de^ree of complexity In the passage as well as more difficult vocabulary 
.in the four response opticftis. An even more difficult comprehension question 
required the pupils to derive a conclusion from factual Information, as illustrated 
by Example 0. , ^ 

" • / < ^ 

Example 0 ^ 



Read the story and answer the questions. 

Most people believe that earthworms are of little use except for fish bait. Put 
scientists have found that they are very important. Eorthwoi:ms eat soil. ^ They make 
the soil better by grinding it up as It passes through their bodies. • The holes that 
earthworms make as they burrow in the earth mako it easier for the roots o^ plants \^ 
to enter the soil. Earthworms use leaves to line their anderground homQs. These 
leaves/make the soil* richer. Scientists' have found that oarthworms are the earth's 
plowmen. ' They keep stirring up the soil which helps to raise better^'crops. 
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Exampl^^O (cont.) 



Grade 2 



(10) 
(24) 
..(56) 
(10) * 



Etrthworms should have no trouble 
Grade 3 finding 

(7) O company. 

(19) . O crops. 
(67)- •food.. 
( 7) O fishermen. 



Only 56 percent of the second-graders and 67 percent the third-graders selected 
the best answer on. the inferential question in 'Example 0, 

The members of the Reading Assessment Advisory Committee concluded that, given 
the difficulty of the interpretive-critical questions, .' California' s second-- 
and third-graders are doing very^ well. 



IV. Reading Achievement for iGrades Six bnd Twelve 



Synopsis of Findings * ^ 

In spite of a very slight decline (;2 percent *correct) in sixth grade reading 
.scores, the median sixth-grade student in California continues to rank at the ^ 
53rd percent^ile on national norms' in reading achievement --three points above 
the national average. On the other hand, a decline of .5*percent ^correct in 
twelfth-grade reading scores translated" into a loss of one percentile point 
on national norms. ' Thus, the median twelfth -grade student dropped from the 
42nd to the 4lst percentile and is now 9' percentile points below the national 
average. Se^ Chapter VIII, "Comparisons with National Norms," for details." 

Since 1974-75 the members of the' Reading Assessment Advisory Committee have 
reviewed and analyzed^ statewide reading "results, .By weighing percent correct 
scares ;for each item against their ext>^ctatjtons of student performance at different 
ages, the ^onmittee members have been able to idtotify areas of relative strength 
and weakness. While such judgments reported here are based upon the Committee's 
analysis, the Department of Education assvimes full responsibility for the contejit 
of this report. ^ 

M the review of sixth-grade results, the members of the Reading Assessment*^ 
Advisory Committee were 'generally satisfied with sixth-^grade reading performance. 
However, .they suggested increased instructional emphasis in the following skill 
areas as a means of improving the reading comprehension abilities of sixth- 
grade students: (1) structural analysis . (recognizing the meanings of roots, • 
suffixes, and prefixes); (2) vocabulary (developing knowledge of word meanings 
and the use of context clues); and (3) interpretive-critical comprehension 
(interpreting, evaluating, and inferring from informatioij and ideas stated in 
Written material) . * ' " / 

Twelfth^grade performance measured up to the exp.ectatipns of the Reading Assess- 
ment Advisory Committee^in most Trading skill- areas* The members of 'the committee 
observed that twelfth -grade performance was generally strong on questions requiring 
.them to identify easily detectable, explicitly stated elements in written material 
presented in a straightforward manner. ^ The committee noted, however, that 
performance tended to be weaker j3n tasks rejquiring' studenta to read carefully, 
infer conclusions from details, and use subtle^clues in detecting the author's 
attitude or Implicit intent. ' ' ^ , 
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Reading Results for Grade Six 



Test Scope ^ > 

The; reading section of the Survey of Basic Skills: Grade 6 consisted of 128 * 
questions. »<*The items were selected to assess a wide variety of objective^ 
discussed broadly in Framework in Reading for the Elementary and Secondary 
Schools of California (Sacramento: California State Department of Education, 
1973) 'and specified, with the help of the Reading Assessment Advisory Ci>mmittee, 
in >Test Content Specifications for California State Reading Test's (Sacramento: 
^California State Department of Education, 1975). Both the objectives and 
the; ques,tions used to assess them fall into one^of fiye major skill areas: 
wofd identification, vocabulary, literal comprphensioji, interpretive-critical 
comprehension, and study-locational skills.^ The emphasis assigned to each o£^ 
the skill areas on the Survey of Basic Skills: Grade 6 is presented graphically 
in Figure. 1. 




Fig. 1. Number of questions, by skill area; in the reading portion of the Survey of Basic Skills: Grade 6 
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Comparison of 1975-76 and l»76-77 Results /Grade Six ^ ' ' 

The results of sixth-grade performance on the total'^ reading test and in each of 
the skill areas for 1975-76 and 1976-77 are presented in Table 4* The changes 
in overall .performance and skill area performance also are shown in Table 4. 



Table 4 

Reading Performance of Califoraia Sixth-Grade Students 
.* .on the Survey of Basic Skills; Grade^6 



Skill area 



Numbef-of' 
questions 



Average percent 
correct 



1975-76 



1976-77 



Gain (+) or loss (-) 
> ^ in score 

t4 -2 0 +2 



vf4 



TOTAL READING 

Word 

Identification 

Vocabulary 

Comprehension 

Literal 

Interpretive- 
Critical 

. Study-Locational 



(128) 
18 , 

69 
39 

■ 30 
16 



(66.1) 

.74:-3 
67.1 
64,9 ■ 

61.8 
60.0 



(65.9) 

74.2 
_ 66.3 ' 
64.9 
67.2^' 

62.0 (T 
59.8 



(-0.2) 

-0.1 
-0.8 
0.0 
-0.2 

+0.2 
-0.2 



The data in *Tablfe 4 reveal a very ♦flight decline of .2 percent correct in ^ 
overall sixth-grade reading performance. The loss in the «ea-<^ literal com- 
prehension was balanced by an equivalent gain in interpretive-critical compre- 
hension^ resulting in no change for the total comprehension skiJLl area. . 
Performance in alT the other skill areas^ declined slightly. The largest .decline 
(.8 percent correct) waa in the area, of yocabulaVy* 



D iscussion and Analysis of Skill Area Reisults, Grade^ 

The members of the Reading Assessment Advisoil^ Committee have consistently 
stressed that comprehension,, the ability to understand written material, is the 
ultimate goal of all reading instruction. However, comprehension , is a complex 
process, composed of an interlocking hierarchy of skills. Therefore, the following^ 
discussion is designed to illust^rate patterns that arp characteristic of sixth- 1 
grade reading performance in the areas of word identification, vocabulary, j 
literal comprehensioni and interpretive-critical comprehension; which constitute 
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the hierarchy of ^kill areas tested •on th^ Survey of Basic Skills; Grade 6 . 
these skill areas are 4iscHSsed below in the order of their complexity moving 
from lesser to greater degrees of complexity.' The reader may wish to ref6^ to 
Appendix B for additional Information and examples pertaining to each of the 
skill areas. - , ' 

Wo/d Jdentiftcation . Eighteen of thfe 128 questions oti the sixth-grade reading 
test assessed word^identification skills; i.e., recognition of sound-letter 
correspondence^ and knowledge of word parts.* Because the questions required 
students to process inArmation at the word level only, one would expect per- o , 
formance toybe highest in this area. As the data^n Table 4 reveal, this was 
the case. The percent correct for word identificOTion, 74.2 percent correct, 
was higher tlian the average skill area scores in the other areas.. However, 
stnce some of the questions were harder than others, scores did vary considerably 
from 90. percent correct to 49 percent .correct. 

The following three prefix questions (examples A^ p, and C) illustrate the range * 
of performance. (The corresponding test passages ai?e omitted, here for tj>e 
reader' s .convenience. ) The percent of students who selected eacl^ response is 
shown ajp the left of each response. 



-lETxample A 



We know from thq^^prefix di£ in the worct 
disagreeaWe in paragraph 3 that the odor of a 
spon'ge would 

( 4) O^gree with Q|her animals. 
(83) ^nbt a^ree with ollfier anjmals. 
( 6) O often agree with other animals. 
( 7) O probably agree with other'animals. 



Example B 



We know from the prefix un m the word 
undyed that the woolen cloth was 

( 7) Odyed apart. 
( 7) Odyed back. 
(14) Odyed over again. 
(72) ^ not dyed. 



Example C 



^ We know from^the prefix semi in s ^emicircle 
that it was in the shape of a 

(16) O whole circle. 
(58) •half circle. 
(14) O quarter circle. 
(12) O big circle. 
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The examples aboVe suggest that variations in performance *on prefix questions 
depended primarily upon thej particular^ prefix beingv tested* 

A similar, pat tern /of vajriable performance was evident on the cluster qf suffix 
questions, as the Ifbllowing three examples (D, E, and F) illustrate (the. corres- 
ponding test passjGiges ^re omitted): ^ 



Example D 



IrT the third sentence the suffix -est in the 
word fattest means: 



(13) O having more fat 
( 3) O having less fat 
{ 3) O'having the least fat 
(81) •having the mosi tat 



1 



Exataple E 



7^ 



The yvofd investigator means: 

( 5) O investigation 
(78) • on^ who investigates 
( 8) O the act of investigating 
( 9) O to investigate' 



Example F 



The ending of the word harml^ helps to 
make the word' meanr 

( 8)0 harmful 
(67)^ without harm 

( 3)0 very harmful ^ - • 

( 1)0 more harmful 

(21)0 less harmful * ^ 



While the scqjres on most word identification questions were generally high, they 
are representat>ive of a skill area that is probably more amenable to instruction 
than some of the more complex reading skills. The members of the Reading 
Assessment Advisory Committee noted in Student Achievement in California Schools; 
1975-76 Annual Report (Sacramento:. ^California State Department of Educaftion, 
1976, 1). 19 ) that^ increased instructional emphasis in the meanings of roots, 
suffixes, and prefixes may constitute one relatively ^fficient means of helping 
students improve their reading comprehension abilities* ^ 

\ 
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Vocabulary > Th(^25 vocabulary questions on 'the sixth-grade reading test: required 
students to identify the meanings of words as they were used iti a paragraph. 
As can be^seen from Table 4, th^ average score for vocabulary was 66, 3. percent 
correct. While scores of 60 percent correct or above were obtained on 21*'Of 
the 25 vocabulary questions, the range af scores ran from a high of 85. 2. percent 
correct to a low of 19,9 percent correct.^ The percent correct .scqres. appeared 
to vary with the difficulty of the, test word and with the degree to tWiicfi 
context clues could be used, »; 

c * 

The easiest vocabulary item on the sixth-^rade te^t is shown below (Example G) : 



Example G 



Squirrels are found pr.actigally eyer/where'ex- 
cept in the distant countries of Madagascar a'nd 
Australia. The common squirrel of Europe and 
North Asia is dusky red in color. In North Amer- 
ica the gray squirreJ h seen more-often. 

But the most beautiful squirrel in all the world 
is the raffalii Squirrel. This N'ttle animal lives 
only in hot jungle countries and is almost as 
brightly colored^as a bird. Its head, back, and 
tail are black as coal. Its sides and shoulders 
'ire a snowy white, and its underparts are a'desp 
and lovely red. ^ 

Of all the squirrels in the world the raffalii has 
'the easiest life. Squirrels in northerr. countries 
must store away enough food to pcovide for the 
long winters. But the raffalii never hc.s to worry 
about food^ for there is always plenty. 

Tfi^gffalii does not everr have-to bgild a house 
;o li^mp- Other squirrels must find a hollow in 
fi tr6d or dig out a \\o\e in some fallen log in the 
woods. The raffalii's home is already there for 
him. It consists of the basket ferns that grow in 
Ihe'S^mp branches of jungle trees. These soft 
ferns are really shaped like squall baskets. So all 
the littre raffalii has to do-when he wants to go 
to bed is jump in^o one of them and be, rocked 
to sleep in a ready-maSe treetbp cradle! 



The word taM in the second paragraph means: 

( 4) O story (85)i^ part of an ^nimal's body 
( 2) O follow ( 9)0 the back of a bird ' • 



As one can see fron the itMi data, percent of the students- confused "tail" 
with '-'tale"; 2 perdent conffeksed^he nouh and verb usages of the woijid "tail"; 
and 9 percent knew the meaning of the word but failed to detect its usage -in 
the context of this particular passage. ^ 
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Even more students failed to uge the context clues provided^ io the* foJLlowing 
item (Example H) : * » ' " . 



Example H 



Can bees see colors^ If they can, cblor^vision 
is probably useful to thenn. if bres can see 
colors, tliey probably find flowers more easily. 
Bees fly' from flower to flower gath(jring nectar , 
a sweet substancf^ed in nnakinq howev. In the 
proces^ they transfer poljen ,frorn 'flower to 
flower. If it were not for the pollinating process, 
plants couldn't nnake seeds. 

T^o find out if bees can see color, sOnne inves- 
tigators placed two squares 'of paper^one .blue 
and oljle green-in tne bottom of a cage of bees. 
Xhey set a tiny dish on each square. They iMed 
the dish on the blue square with a solutjOR of 
sugar and water and left the dish on thVgrten 
square empty. 

At first the bees landed on both squares. But 
soon they wefe all<Clustered on the l)lue square,, 
feeciin^ on the sugar water. After a vhile the in- 
vestigators emptied the d\sh of.suga-'^water but 
left the dish in the cage. The iDees stifl landed 
only on the blue square., Even whan the squares 
wer^ nnoved to different places \nue cage, the. 
bees went to the blue square. 

The investigators knew, however, tH^X nnany 
animals can't see color; they see things only in 
different shades of gray. Perhaps the bees could 
tell the squares apart because they saw^green and 
blue as different shades .of 'gray. The investi- 
gators replaced the green.square with many gray 
squares, each a different shade. On .each gray 
square they put .an empty dish* on tne one blue 
square they also put an ennpty^dish» As before, 
the bees ^^ed only on the blue squcdfl. ^ 

The word nectar nneans: 

(76)^ a sweet substance 
(11)0 honey 
(11)0 pollen 
( 2)o seeds 



V 4 



To answer correctly the question in Example H, students did not have to kngwL 
the lieaning of the word "nectar"; they' merely needed to observe the definition 
of the word in the phrase followtng it in the passage (underlined here for the 
feader^s convenience). While over three- fourths ot California's sixth-graders 
responded correctly^ the fact that one-fourth of them failelk^to make use ,of ' 
such an obvious context clue is noteworthy. 
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On many other vocabii^ry questions, students could not rely totally on context 
clues.** For example, on' the' following l^tem (Example I), students had t6 know 
the meaning of the test word,- or they were likely to miscue on a context clue 
and select one of the dis tractors. 



Example I 




Can you fmagine a perfect little deer no taller 
than the average ^book? Can you picture a deer 
standing erect with all four feet on the palm of a 
man's hand? ^he mouse deer of Malaya is just 
that size. He measures about eight inches at the 
shoulder, has pencil-sized legs and tiny cloven 
hoofs. ^ • ' 

The pebple of Malaya have built up many folk 
tales and legends about the mouse deer or 
*pelandok, as they call the attractive little animal. 
He is like "Reynard the Fox" in European 
fables, and lil^e "Br'er Rabbit" in American^ 
stories. He is, of ^urse, a harmless little animal, 
and having no means- of defense, has a great 
many e'nemies including a few natives who some- 
times have a dinner of pelandok stew. 



^The word average means: V 

(lO)O.pencil- or pen-sized 

(65)^ middle or typical 

(16) o little or small 

( 9) O the size' of a man's hand or foot 




committee members expressed surprise that only 65 percent of the students 
correctly identified the meaning of the word "average" on this question* . , 

Sixth-grade students ' performance on these and other vorttbulary items suggests 
two additional strategies for strengthening students ' comprehension skills: 
(1) increased instructional emphasis in the use of coajtext clues; and (2) increased 
instructional emphasis in general vocabulary development. 



Literal Comprehension . While the' word idetitification and vocabulary questions 
focussed upon individual words and parts of words, the 39 literal comprehension 
questions required students to identify explicitly stated elements in v^ill 
larger units of material, suc^i as sentences and clusters of sentences. Tbe — 
a ve^s^e 'percent correct for literal comprehension was 67.2, and the scores 
ranged from a high of 91 percent correct to a low of 32 percent correct* 
^Scores over 60 percent correct were -obtained on about three- fourths of the 
39 literal comprehension quesirlonff* A major factor that affected the -difficulty 
of the literal comprehension questions was the amount of information upon which 
a given question /was based* Some questions were based upon inforrmatiofi contained 
within a single sentence, whereas others werexbased on information from a .. 
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series of sentences. For exampfe, the following literal comprehension question^ 
(Example J) could be answered by referring to a single sentence (underlined- 
here for the reader's convenience)* 



Example J 



A new kind of star is shining over New York 
City. It is at the top of a tall, steel towerjon an 
office building. It can be sefn from a distance of 
five miles and tells by changing its color what 
kind of weather New Yor1< Gity is going to have. 
• Clear weather is coming if the star is green. 
Orange means the weather will be cloudy. If the 
star is flashing orange, New York children wear 
rubbers and raincoats because rain is on the way. 
When the star is flashing .v^hite, snow is on the 
way and children get out their sleds. This is the 
most modern way to predict what the weather is 
going to be. For a longtime radio and newspapers 
were the'principal sources of information con- 
cerning the vyeather. Now a new way h^s been 
found. 

How would you like to have a star tell you 
when you car^^go on your picnic? Maybe the star 
will tell you the weather is unsuitable and you 
will have to ea^ yourpicnic lunch inside. ^ 



A gr^n star shining atop the building means 

( 4) O children should wear their boots. 

( 2) O snow.. 

(91) •cle^ weather. 

( 3) O children shQu|d get out their sleds. , 



On this particular question 91 percent of the sfudents Selected the correct 
response, ^However, another literal question which was based upon the same 
passage proved to be more difficulty This question (presented bellow as 
Example K) was derived from the first three sentences of the passage shown 
in Example J, The. literal comprehension task in this item Involved relating 
the word "It" in the third sentence back. to its referent, "A new kind of star" 
in the first sentence* , ^ 
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Example K 



What can be seen from a distance of five miles? 

( 6)0 New York City 
( 14 )0 A steel tower 
( 5)0 An office building 
(75)^ A new kind of Itar 
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A lesser proportion of students (about th ree-fourths) successfully h&ndled the 
more complex literal comprehension it^. Therefore,, one can see that (all 
other tilings being equal) it is geirerally easier for students to process 
infonpation contained within a single sentence than it is for^ them to Identify 
the referent^ of particular words ^appearing in different sentences. Student, . 
performance on this question Suggests- that helping students understand the 
relationships between words and their referents is anothet important strategy 
for improving students' comptehension abilities. • ^ • . 

Another major factor that affected the difficulty of the literal comprehension 
questibns was the overall difficulty , (or readability level) of the test passage 
Example J, for instance, is a within-sentence literal comprehension question 
based on a passage with an-estimated sixth-grade readability level. ^ The 
following item (Example L) is also a within-sentence literal compreliension 
question, but it i& based upon a passage *with an estimated seventh-grade read- 
ability level. > , - 



Example L 



Can you imagme.a perfect little deer no taller 
than the average book? Can you picture a deer 
standing erect with all four feet oh thie palm o^f a 
man's hand? The mouse deer of Malaya is just 
that size. He measures about eight inches at the 
shoulder, has pencil-sized legs and tiny cloven 
hoofs. 

The people of Malaya have built up many folk 
tales and legends apout the njibuse deer or 
pelandok, as they catTthe attractive little animal. 
He IS like "Reynard the Fox" in European 
fables, and like "Br'er Rabbit" in American 
stories. He is, of course, charmless little animal, 
and having no means of defense, has a great 
many enemies including a few natives who some- 
times have a dinner of pelandok stew. 

T 

A pelandok is a: 

^(13)0, fox 
( 6) O folk tale 
(71) • mouse deer 
( 1) O country , . ^ 
( 9)0^;a^it 



Whereas 91 percent of the students selected the correct answer in Example J, 
only 71 percent successfully handled the same kind of question, which was based 
upon more difficult material. The difference in scores on these two items 



1 

The readability estima^tes in this document were determined from the Fry 
Readability Graph T^which is based on the average number of syllables and 
^ averse number of sentences per 100 words. / 
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reveals the inverse relatilons^lp between comprehension and rea^abllltty ; that 
is, as the difficulty of reading material increases, students' comprehension - 
of the madniaJL decreases* ' ^ ' ^'''^ ' ^ f - ^ ^ ^; 

Interpretive-Criti-cal Comprehension ; The most difficult and comp^lex reading' 
comprehension * ski 11 area is interpretive-criclw'^l*Hcomprehension. The 30^ ,^ 
interpretive-critical comprehensj^on, questions on the sixth-grade reading test 
required students not only to comp1feeh.<^iHi explicitljr stated material in a passage 
but. also to draw inferences from ^th^t? material. * As one might .exjilfct, this ^ 
skill ar€i^ was more difficult for students than atfy of the previpuSfly mentioned 
skill areas." The average percent correct for interpretfve^critfcal comprehension 
was 62.0.; scores ranged from a high of 90 percent correct iow of ^^.p^jercent 

correct. , . ' . * 

The 90 percent correct s8^re was achieved on thejaqbestion in Exa^aple M.a This 
item was based upon a passage that is probably 'r^r£g£nta^ve of some b^tfv!| 
easier reading materials encountered by si«th-grMy|KT^The qu^ttiott asked. 
students to determine what the story was mostly aoou^. ^ince all the options 
given were mentioned in the passage, the* students had to weigh th^ various 
choices and decide which one represented the main ide^i., Thus, the item, appears 
to be a good test of the students* overall comprehension of the passage. 
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Example M- 



My name is James, same ^as my' father's. My 
mother calls me Jimmy. My father is called Jim*. 
He-always-^wakes me up in thre morning. He calls^ 
me Jim. I hope I'm like him when I arow up. 

My father works as a pltHnlwJP'y helper, and 
for extra monev^ he is a night watchman. Mother 
• says that Daddy work^ very hard to make^us^ 
h^py, and Daddy says the same thing about- " 
Mother. Both Daddy pnd Mother say that we 
make them happy because we are their children. 

^Qn Sunday we all go to church together-my - 
father, mother, my older sister, and my younger 
brothers, Jerry and Willie, and L When we come 
home, we have a gbod dinner. We have fun on 
SuQjJays. Daddy and Mother don't have to go to 
work then. They have time to pla^ with us or 
take us for a ride in the car. • . 



The story tells the most about 

' ( 2)0 w^3t l''|:)lumber do^s. ^'^ 
(90)^ a happy family. ^ 

( 6)03 hard job. 
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Another i^erprfetive-critical comprehension question based upon the same 
passage presented more- difficulty. This question (Example N) required students 
to make an inference from the first sentence of the third paragraph (underlined 
^in the passage for t^e reader^ s convenience). 



'Example Nf^ 



Yc^u can, tell from the story that James is the- 



( 9)Oo<dest child. 
(71) • second oldest child. 
(12) O third oldest child. 
( 8) O youngest child. 



While 90 percent sjiiccess fully identified th^ main idea of the gassage, only 
71 percent of the students reached a correct concluaion from a detail contained-^ 
within the aitme passage. Thus, 29 percent failed to make* the correct inference 
from the key information provided ot failed to Igca't^ the^ sentence containing 
the key i^nformatioh in the firsts place. 

The item below (Example 0) illustrates one of the most difficult questiona- on»- ^ 
th% test. **' *.- 



Example 0 



lyiy mother liked to tell about one visit they^ 
made to Chief Pereshonts' grave. The children- 
were always half afraid of this deep cavern in the 
black rock, becau$e they had been told that 
Pereshonts' squaw and horse had been killed and 
"bljried with him. Mother's sister -Patty was a 
daredevil; so when one oT the cousins dared her 
to enter the grave, down she went. Shelalled up 
descriptionS'Of the skeletons, and they realized 
that what they had been told was true. This gave 
them a strange feeling, and they were in a hurry 
to .leave. Bui Patty took her time coming out of 
th^^rave^^She brought a skull which she said was 
that of Pereshonts, and she chased them all 
home with it 

Grandnrtother shuddered when Patty set the 
thing on the mantle, and^ Great-Aunt Mary 
teasegi, saying ^ that Pereshonts' ghost would 
come' for it Patty scoffed at the idea of ghosts 
arid calmly ate her supper. SWb put the» skull on 
her bedpost that night. 

In the night she* woke my mother.and whis- 
pered, "Listen!" There was a tap-tap-tapping on 
the window. After a time it came again, like the 
soOnd of a fist on the^lass. The girls hid their 
heads undeY the covers and clung to each other. 
They did not^sleep for what seemed like hours. 



"^1 
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. Example 0 
(cont . ) 



When my mother finally awoke, the sun was 
JiidfT. Patty was gone, and so was the skull. For 
Xne first time, my mother noticed the pear on the 
tree <hat grew near the house. The slightest 
breeze 'made it tap on the window. When Patty 
came back, she admitted that she had returned 
Pereshonts' skull to the grave. She would never 
admit anything about what had happened in the 
night, 

"I want the skull to be there when our chil- 
dren go to look," she explained. 

It was there'when we went years later. 



What appears to be the writer's feeling toward 
Patty? 

(34)^ Loving and amused • 
( 9)0 Jealous^ 
(23)o Severely critical 
(34)0 Scornful 




About ^ one -third of- California' s sixth-graders successfully identified the writer's 
attitude in the storjr* Student performance on the above qtOestion suggests that 
many students may need considerable Instructional assistance in learning how 
to detect a writer's attitude or point of view. Moreover, uneven performance 
througHout tl|e interpretive-critical comprehension skill area has ptompted 
the members of the Reading- Assessment Advisory Committee to observe that 
greatef instructional emphasis is needed in th^ critical skills of interpreting, 
evaluating, an4 inferring from information and ideas stated in written material. 



\ 
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Test Scope 



The reading section of the Survey of Basic^ Skills ; Grade 12 consisted of 141 
questions.. The items* were designed tp assess a wid^ orange of objectives, dis- 
cussed broadly in Framework in Reading for the ElemeAtary and Secondary Schools 
of California and specified, with the help of the Reading Assessment Advisory 
Committee, in Test Content Specifications for California State Reading Tests 
(1975). As shown in Figure 2,^ both the objec^^es ^d the questions used to 
assess the achievement of the objectives fall into one of four reading s^ill 
areas: vocabulary, literal comprehension, interpretive-critical comprehension,- 
and study-locational skills. Figure 2 also illustrates the>elative degrees of 
emphasis placed upon each of the skill areas" on the Survey of Basic Skills; 
Grade 12. 




Comprehension 
(97 items) 
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Comparison of 1975-76 and 1976-77 Results. Grade Twelve ' 

Twelfth-grade results on the total- reading test and in each of the skill are€i^, 
for 1975-76 and 1976-77 are presented in Tablg 5. The year-to-year changes 
in overall performance and skill area performance are also* shown in Table 5. 



Table 5 

Reading .Performance of California Twelfth-Grade Students 
on the Survey -of Basic Skills: Grade 12 



* Skill area 


Number of 


~ -r- — 

Ave.rage percent 
correct 


. Gain (+> or loss (-) 
in score ' ) 




questions 


1975-76 


1976-77 




-4 -2 ( 


) +2 4A . 


TOTAL READING 


(lAl) 


(644) 


(63.6') 


(-o.'s) 






Vocabulary 


31 


61.3' 


6p.9 


-0.4 




J 


. Comprehension 


97 


64, 5 


63.9 


-0.6 






Literal^ 


47 


69.2 


68.9 


io.3 






Interpretive- 
Critical 




60.1 


59.3 


-0.8 


/ ■ ■ 




S tudy-Locat ional . 


13 


6^.4 


"67.2 


•-1.2 







.As the ddta in Table 5 indicate, twelfth-grade reading scores declined slightly 
in all skill areas from 1975-76 to 1976-77, Th> largest- decline was * in the 
study- locational area, which involves such study skills as the ability to use 
the dictionary, parts of a book, and reference materials. , " 

Discussion andi Analysis of Skill Area ^Results! Grade Twelve 

While the members of the Reading Assessment Advisory Committee have stressed ' 
the importance of comprehension at all grade levels,-* they have emphasized it . 
to the greatest extent at the twelfth grade*. 51ie cbmposition of^ the twelfth- 
grade reading test reflects this emphasis. As one can see from Figure 2, 
97 of the- 141 reading questions measilred eithet literal or interpretive*-critical 
comprehension. Because of this ^mpha;5is the following discussion pertains 
only to the performance of California'^ fwelftji-graders. in tlie ar^ea of Compre- 
hension, . " I 

The comprehension questions were based upon passages drawn from a variety of 
materials including essays, poems,, newspaper articles, Mvertisements, recipes, 
charts, and graphs. A number of comprehension ^question87 followed each passage. 

] 
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The questions ^re classified as either literal .or interpretive-critical. 
The literal comprehension questions requited students to identify exf)licitly 
stated elements in material, whereas the interpretive-critical comprehension 
questions, required students, to infer new interpretatiops oi^ conclusions fcrom 
explicitly stated material, All other things being equal, the additional 

'reasoning required to answer the Interpretive-critical comprehension questions 
typically renders them .more difficult than- the literal comprehension questipns. 
Thu^, the committee was not surprised that, the average percent correct for the 
literal comprehension questions was 69.0, while the average percent, correct 
for^ttie interpretive-crf tical comprehension items was 59,3 (a 9,7 percentage 

' point differential between the averages' of the two categories), ' 

- A few actual test questions are included in the following discussion to illus- 
trate the patterns that are characteristic of twelfth-grade students' performance 
in "the literal and interpretive-critical comprehension skill ^reas. The readep 
may wish to refer t'o Appendix C for further descriptions of the skill areas . 
tested, more detailed test results, and additional; illustrative test auestions. 

' , V w ^ • 

Literal Comprehension ^ . Even though the literal comprehension questions were 
geneVally easier for students than were the interpretive-critical comprehension 
questions, the scores on the 47 literal items varied from a high of 93 percenj 
correct to a low of 23 percent .correct. 

The high in tKe range mentioned above is illuslspated in the following question 
(Example A) . \^ ^ " ► 




Example A 



Th« msuranc« afforded is only wi.h respect to such of th« following coverages as are indicated by specific premium charge or .changes. 
The limit of .the'^-torjipany's Itabih'y against each such coverage shall be as stated herein, subject to all the terms of this policy hivtng 
reference thereto. » 


A. BODILY INJURY. 
LIABIUTY 


8. PROPCf TV 
DAM AC £• 


C. MEDICAL 
PAYMENTS 


D. Hi COMPREHENSIVE 
EXCLUDING 
COLUSION 

U) PERSONAL EFFECTS 


E. itOLUSlON 


F. UNINSURCP 
MOTORISTS 


* coverage:. 

r 


Thousand 
Each 
Person 

f 

$25 ' ^ 


Thousand 

Each 
Occurrence 

$50 


Thousand 

Each 
Occurrence 

$10 ^ 


Each 
Person 

$1,000 


(1) Actual Cash Value 

(2) * $T00 


Ai;tual Cash 
Value 
Less 

* 

Sl.OO 
Deductible 


Thousand 
Each 
Person 

$10 


Thousand 

Each 
AccKient 

$20 


Limits of 
Liability 

- — 


' Total PremHJTi 
« * 

$143.40 


$37.80 


$25.00 


S9.00 


$20^0 


$45a0 ^ 


$6.00 ' 



\ 



What IS f.he mnximiim nmoiint prr person for 
which this policy covers medical bills? ^ 



(93)^$1.000 

( 2)O$&,000 



( 3) O $10,000 
( 2)0 $25,000 
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, The question in Example A required students, to locate the column headed ^'Medical 
Payments" and the amount* listed (iire'ctly under "Each Person." Therefo're, the 

* task was primarily one\of perceptually matching key words in the question with 
key words on the insurancS^form, , 

Most literal comprehension questions were more difficult than that in Example A. 
Whereas the question in Example A was based upon easily detectable infonu^i^on, 
the following item- (Example B) was based upoti a sentence "buried" in a fq/fr-- ^ 
^l)aragraph passage with. a ninth-grade readability, level. Thus, the passage is 
typical of material 'that mi^ht be found in a ninth-grade science textbook 
and is illustrative of reading that students are often retjuired to do in 
school. The quesA:ion in Example B is a literal comprehension question based 
upon specific information in the secojid sentence of the thi^d paragraph (under- 



lined here for the reader ^s convenience). 



Example B 



Same members of the inject world have been 
equipped by nature with^special weapons that 
protect thenri against their enemies, and others 
have been^made distasteful or even poisonous.' 
► However, certain insects that are both tasty and 
weaponless have been/givert unusual and effec- 
tive means for remaming* alive. Among these 
means are protective coloration, mimicry,' and 
protective reseiYiblance, 

Protective coloratiorf blends the insect with 
' his environmerrf For example, there are t)utter- 
flies that, though' strikingly beautiful in flight, 
^show only dull colors when, flying wings folded, 
^ they rest on the bark of a'^tree or shrub. 

Some butterflies, such as^ the monafrch, are 
extremely dpstcsteful to birds. The quite tasty 
viceroy, however, escapes harm by mimicking 
the offensive fnonarch'. 



The talking leaf avoids the hungry birds' 
attentioVi by looking lika a green leaf, and the 
butterfly known as the dead leaf ►s ignored 
l>ecause he so closely resembles the texture and 
shape of dead leaves orvthe branches that are his 
usual resti'ng place. 



Whicff, if any, is the major protection of the 
viceroy? 

«• 

( 7) O protective coloration 
(72) • mimicry 
( 9) O protective resemblance 
( 2) O repulsive appearance 
(10) ONone^of these 
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On thg question given above, 72 percent of the students correctly selected 
"irfimicry." An analysis of the task- and errors suggests that the^ other 28 
percent of the populati*on either failed to locate t"he sentence containing 
information about the viceroy or failed to discriminate between >"mimicr5r" '^Z 
apd other distrac'tors , such as ^'protective coloration" and "protective resemblance?^ 

\ ^ 

The following t6st question' (Example C) illustrates still another kind of diffi- 
culty presented in some of the literal comprehension items. .The- question is a . 
deceptively simple one that asks* students to identify four ingredients that \' " 

are to be combined after the first step of the recipe. In fact, it is a 
question tjhat demands .fairly * careful reading, or the reader is likely to select 
the fifth option. 



Example C 



V 



ENGLISH MUFFINS 

f^. 1. package active dry yeast 

^/^cup warm water 
VA cups milk; scalded 
2 tablespoons sugar 
2 teaspoons salt 
Va, cup shortening 

5?^tci^cups sifted all-purpose flour 

Spften yeast in water. Combine *next 4 ingre- 
dient's; coc»/ to lukewarm; Stir in 2 cups flour; 
beat well. Add yeast; mix. Ad^-^eFitHjgh of 
remaining flour to mak? a moderately stiff 
dough. Turn out on a* lightly nloured surface; 
knead till smooth '(8 to 10 minutes). Place in 
lightly greased bowl, turning dough once. Cover; 
let rise till double*(VA hours). 

Punch down; cover and let rest'^IO ninutes"; Roil 
to slightly less than Vr inch thiqk on lightly 
floured surface. Cut with a 3-inch round cutter. 
(Reroil edges.) Cover and let rise till very light 
(VA hours). Bake on top of range on medium 
hot greased griddle; turn frequeptly till done/ 
about 30 minutes: Coo^ thoroughly. Split vvith 
a fork; toast on both sides. Serve at once. Makes 
2 dozen. 



After softening the yeast in the water, what 
four ingredients are combined next? 

(33) •Scalded milk, sugar, salt, shortening 
( 6) O Yeast, warm water, scalded mi Ik^gar . 
( 3). 02 cops flour, scalded milk; sugar,. salt 
( 3) 02 cups flpur, warm water, scalded milk, 

\ sugar 
(S'S^^O None of these / * 
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A close study of the -above item and* its error pattern suggests^^at the large, 
proportion (55 percent) of students who;Selected the fifth option probably 
failed to observe that the water-was used in the first step of the recipe . 
and were consequently looking'^for "water, milk, sugar, and salt"; §ince *ttiat . 
particular combination of ingredi^nts was not listed, they selected "None of. 
these.*'- After observing twelf th-gifade students' performance on items like^ 
this one, thei mmbers of the Reading Assessment Advisory Committee surmised 
that many of California's twelfth -graders do not read carefully for ^detail. 

Interpretive-Critical Comprehension . On the average the interpretive-critical 
comprehension questions were more difficult than the" literal comprehension 
items. As was th6 case for the literal comprehension skill area, the range of 
scores fpn the interpretive-critical comprehension items was a wide one — from 
a high of 92 p3/rcent a<frrect tbTa low of 23 percent correct. Thus, it is 
evident that the interT>retive-criti\:al comprehension questions included some 
ea^y, some moderately easy, and some difficult items. The questipn below 
(Example D) proved to be easy for. most students. 



Example D 



Skiing has recently become one of the 
more popular sports Jn the United States. 
Because of its popularity, thousands of 
winter vacationers are flying north rather 
than south. In manyarees, reservations are 
required months ahead of time. * ' 

I discovered the accommodation shortage 
through an unfortunate experience. On a 
sunny Saturday morning I set out from 
Denver for the beckoning slopes of 'Aspen, 
Colorado. After passing signs for other ski 
areas, I finally reached •■'my dcstirration. 
Naturally I lost no tinr^^KLheadiiig for the 
' nearest tow. After a stimuraWmg afternoon of 
miscalculated stem turns I was- famished. 
Well, one thing led to another a^nd it must 
have been eight o'clock before I concerned 
myself with a bed-for my bruised and aching 
bones. 

It took precisely one phone call to ascer- 
tain the lack of lodgings in the Aspen area. 
I had but * one 'recourse. My auto and I 
started the treacherous jaunt over the" pass 
and back toward Denver. Along t1ie way, Y 
went begging for a bed. Finally a ,olly inn- 
keeper took pity and for only.thioy dolTars 
a night allowed me the privilege of staying in 
a • musty, dirty, bathless ropm above his 
tavern. » * 
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The author's problem would have been avoiclo(f 
ifheKa**r 

( ^) (:>nol fired himself out skiing^"' 
( ^) Otaken a bus instead of driving, 
( 1) Olooked for food as soon as he arrive^.^ 
(92) ^airanijed for accommodations well ahead of 
• his trip.,, ; y 



• X 



The question tested not only the students* overall comprehension of the author's 
problem but ^Iso their ability to infer how the problem' might have been avoided 
in ^e firsts place. On th±s item 92 percent of the students responded correctly 
and thereby demonstrated th^ir grasg-of the primary message of the article. 
The performance of twelfth-grade stiidents on items such as this one has led ^ 
the Reading Assessment Advisory Committee to conclude that twelfth-graders are 
generally fairly skilled at ideptifyihg the main idea or explicit int;ent of 
an article. * * ^ • 

In some written materials main ideas {are implied rather than explicitly stated 
and must be inferred or interpreted from subtle clues. As one might expect, 
students encountered more difficulty on such questions, as illustrated by the ' 
following (Example E) : 



Example E 



APPARENTLY WITH ^0 SURPRISE 

Apparently with no surprise 

To any happy flower, 

The frost beheads it at its play - 

In accidental power. I 

The blond assassin passes on, / 

The sun prqceeds unmoved ^ 

Ta Pleasure off another day 

For an approving God. - ^ 

by Emily Dickinson 



The MAIN idea of the poem h t|iat 

( 3) O God is cruel. 

(24) O forces in nature are kind. 

(11) O the sun punishes frost, ^ 
(62) nature is- indifferent. 



Comprehending this poem involves certain aesthetic appreciation skills, such 
as ^upderstandiiig the figurative language "The blond assassin" and detecting, 
the irony in the last line. On this item 02 percent ',of the students correctly 
equated the main idea of the poem with "nature is indifferent," The very great 
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difference between the correct ai^swer and the other three options suggests 
that the remaining 38 percent of the students were very confused by the poem.r 
This item illustrates a common difficulty demons tr-a tied by students on a' variety 
of other Items that required %hem to use subtle cfues in detecting the author's 
attitude* This apparent Weakness was noted by the Reading Assessment Advisory 
Coramitte^e in the 1975-76 Annual Report* (See p* 28.) 

The members of the committee- have also noted that students seem, to enjCOurfter> 
even more difficulty on questions that require them to draw inferences fl^oj 
details (Example F) , ' ^ ^ 



Example F 



A' 



The thirty years from 1455 to 1^5 were a 
period of almost constant civil war b^fc^een the 
supporters of two branches of the royal family— 

.the house of Lancaster apd the house- of York^ 
This fighting \i usually called the W^r of the 
Roses, because the^tpuse of Lancaster'had a red 
rose as its badge, and-^e house of York a white 
rose.. At the end of it, Henry tudorr who be- 
longed to the Lancast^ branch pf the fan^uy, 

^came to the throne' as f^enry VII. He married 
Elizabeth, vOho belonged' to the York branch, 
and thus helped to heal the woun(^s of the 
prolonged conflict. Its chief result was the wiping 
out*bf many noble families and the reduction 
of^he power of these lords and barons so that a 
king could have' his bwn way withput much 
trouble. . , ^ - 

Henry VITs reign (1485-1509) wa^ajtime of 
rebuilding for England. Ije kept order in the 
country and strengthened tUV^^yal power by 

. special courts and economi^ marfagemenL^n 
his reign John Cabot mad^is'fargqiis tr^ acro^js^ 
the Atlantic-the first or mocjen 

"-^ee^^ti^^ contihenT of North* 
Columbus had reached on 
Islands, Henry's economy is se 
his diary when Cabot came bac 




ropeansto 
en?J**v^ere 

Carr^tfea^, 
tPy i/i ^ 
o'K^m^j^at 



fdund the nc9v isle, £10"-less thin fKty d^jgrs. 
for discovering a cohtinent-but ortbui^ji I-^^AC. 
didn't know how important^this d 
going to be in the history of Euig 




According 
the time o 

.(30) oa revblution against the nobility. 
(31) o the settlement of New England/ 
(26) ^the voyages of Columbus. 
.(13) Othe destructi(^n of the house of York! 
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The key to' the question in Example F is contained* in the underlined sentence. ; 
above* One can see that answering this question correctly depended upon 
(I) reading carefully enough to notice the stated dates; (2)*}cnowing the time' 
of the voyages of Columbus; and (3) putting together^ the two pieces of -infor- 
mation^ As the ^item data reveal, just over one-fourth of the students chose 
the correct answer* The perfxirmance of twelfth-grade students on such items 
has led the Reading Assessment Advisory Committee to observe that California's 
high school seniors may be weak on tasTcs that require them to ifead carefuliy 
and draw inferences from details* " . ^ 
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V. Written Expressior^^Achievement for Grades Six- and Twelve* " 

^ . Synopsis of Findings 

Over the past few year$, both sixth- and twelfth-grade written expression 
achievement scores in California have been below national norms* *In 1976-77 
the median sixth-^rade student in California moved from the 4*9th t;o the 51st 
percentile— above the national 'average for the first time. Tlie median twelfth- 
grade student in California, however; moved ftom the 34th to ,the 33rd percentile 
in written expression--17 points below the national average* \^ 

Every year since 1974-75, .the members of the English Language Assessment 
Advisory Committee Jiave reviewed ~€h^^*'T5tatewide" written expression test results* 
By examining the^76-77 scores for each que^tion^in' the light of the maturity 
t>f most eleven- and seventeen-year-olds in wiritten expression, the committee 
members discerned patterns of st;reng|:h and^ weakness iti the performance of students 
at both grade ^evels^. However, the members of the ccinmittee have always quali- 
fied such interpretations with the reservation that^ some aspens of instniction 
and learning in the language arts are not .b^ing tapped by objective testing. 
Thus, the conmittee's judgments we re^ restricted to only those aspects of written 
expression that are amenable to measurement through multiple-choice questions. 
While the discussion of skill-area stretfgths and. weaknesses is based upon the 
committee's judgments, the Department of Education accepts' full responsibility 
for 'the fnte^^etiations in this report. 

AftW reviewing the written expression results for gracte six studenjts, the 
English Language Assessment Advisory Committee ^concluded^hat sixth-graders 
displayed* a respectable tommand of the following four written ^expression skill 
^axeajj:^ ^ C ^ ^ 

Word forms (selecting the appropriate suffix f4r a word in a given 
sentence) ^ 

Standard English- usage (selecting for- a sentence the verb or pronoun • 
which ^reflects standard English usage) * . 

Sentence recognition (recognizing complete sentences, fragments, run-ons, 
and normal English word order in ^sentences) ^ 

/ . 

Sentence manipulation (selejc'ting the most effective sentence or sentence 
felement) . " ' ^ tm\ ^ 




On the other hand, the coinmittee judged that increased instructional emphasis 
is needled in the following areas at the upper elementary level: 

• Language ciioices (selecting the most vivid verb or specific noun*for ^ 
^ given sientence; identifying attitudes conveyed by words or groups of 

I 
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words; ^identifying the audience intended by the author of a prose 
passage or letter) 

Capitalization (recogtiizing words in a sentence which should be capitalized) 

' % • 

• Punctuation (identifying errors in the use of the period, question mark, - 
exclamation point, comma, apostrophe, and quotation marks)' 

The members of the committee were less pleased with twelfth-grade students' 
performance in- written expression than they were with the performance of sixth- 
graders. The committee judged that the performance of twelfth-grade students 
was strong *in the following skill areas: ' ^ ' 

• Wprd fdrms (selecting tKe correct inflectional suffix f or^ a word in a 
sentence) 

• Sentence recognition (discriminating between complete and incomplete 
sente^nces) 

>• Paragraphs (identifying irrelevant material in a paragraph; selecting 
the summary 'Statement of a paragraph; and sequencing elements within 
a paragraph) ^ ^ 

TKe committee mfembers ^pted, however, that increased Instructional emphasis is 
needed in the following areas at the secondary level: 

% *• ■ 

• Wor4^ forms (using, the full resources of the dictionary) 

• Language choices (dtetermining the most specific lor general word from a 
. • * list of semantically related words; inferring the implied attitude of 

a writer from the languagd' choices used in a passage) ' ^ 

• Sentence, manipulation (rejecting awkward, 'stilted, and wordy sentences! 
in favor of "economical and direct statements^ 

• Paragraphs (recognizing the use and purpose- of transitional words, in 
paragraphs; identi^fying inconsistent yerb tenses from sentence to ^ 
sentence within a paragraph) ^ - • 

. • , ' . r, 

Punctuationt arid capitalization (recognizing the basic conventions of 
punctuation and capital iz a tion*) . * , • * 

The pattern of strengths and weaknesses in twelfth-grade students* written 
expression performance continues to parallel a finding, reportfed by the National 
Assessment of Educational Progress, that while many seventeen-year-olds have 
mastered the basics of written English^ they seldom go beyond th^ basics. - 
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Test Scope ' ^ • , 

The written 'expires slon section of the ^uxrvey of Basic Skills; Grade 6 consists>^ 
-of 128 questions. The- items were ^fed^cted to assess a broad arr&y of objectives 
compiled by the English Language Areessment Advisory Committee ^and published 
in Test Content Specifications for the Survey of Basic Skills: Written Expression 
and Spelling, Grades Six and Twelve (Sacramento: California State Department of 
Education, 1975). Both the objectives and the items used^lo assess the objectives 
fell into one of seven major skill areas: word forms^ language 9hoic'es, standard- 
usage , sentence recognition, sentence manipulation, capitalization, and puitctu'- 
ation. The relative degree of emphasis assigned to each of the skill areas on 
the Survey of Basic Skills: Grade 6 is presented graphically in Figure^3. ^ 
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^ y Fig. 3. Number of questions, by skill area, in the written expression section of iheSurvey of Basic Skills, Grad€,6, 
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1976-77 Results. > Grade Six 



Thfe results'^ of sixth-grade performance on the total written expression test* 
and in each of the skill areas for 1975-76 and 1976-77 are presented in Table 6^ 
YearTto-year changes in overall performance and"^ in skl jl ar^ performance are 
shown in the table. « 



Table 6 



Written' Expression and Spelling Performance of California 
Sixth-Grade Students, on' the Survey of Basic Skills; Grade 6 



Skill areajl^ . 


Number of 


Average percent 
correct / 


Gain (+) 
in 


or loss (-) 
score 




questions 


1975-76 


.1976-77 




-4 


-2 0 +2 -+4 


If 

TOTAL^WRITTEN 
EXPRESSION 


■ (128) 


(62.5) 


(63.6) 


(+1.1) 


V 


^ » 


■ 


Word form's 


16 


"^'82.4 


82.3 


-0.1 








Standard usage 


16 


75.3 


' 75.3 


'"o.o 








Language choices 


r ( 26c 


54.4 


56.5 


/;t2.1 








Sentence reCogn^ion 


' ■ 22^ ' 


■ 62.3 


' 63. 'O 


40.7 ■ 








Sentence 
manipulation 


16 


61.7 


62.6 


+0.9 








Capitalization 


14 

> 


57.4 


58.4 


+1.0" 




■ 




Punctuation 


18 ' 

> 


52.4 


« 52.5 


40.1 






w 


tOTAL' SPELLING 


. (64) . 


(63.6) 




(0.0) 






\ 


Relationships ^ 


35 . 


58.1 


' 58.-1 

« 


0.0 






/ 


Word forming 


29 . 


70.2 


70.3 


40.1 . 


1 




(' 



/ 



The data in Table 6 reveal that the written expression scores of sixth-grade 
students increased 1.1 percent in 1976-77. With the exception of word forms - 
and standi^rd usage, studient performance improved slightly in all •of the written 
expresslpn skiM areas. The greatest increases, were in language choices (2.1 
percent correcb)-, capitalization 41 *'0' percent correct), sentence manipulation * 
(0.9 percent correct) and sentence veco^jpAlion fo.7 percent correct). 
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Members of the English Language Assessment Advisory Committee reyiewed the 
1976-77 assessment results as- they have done for the two previous years. The 
conmlttee members judged the adequacy of -student performance in light of the 
inherent difficulty of the skills, the particular items that were used to . ^ 
measure each skill, and changes in pc^rformance from 1975-76 to 1976-77, 

Actual tes^uestions are provided in the, following discussion to illustrate 
the coinnittee's conclusions abdut sixth-grade* students' performance in the various 
written expression skill areas, 7or each Illustrative question the percent of 
the students who selected ea'fch response 'is indicated in pdtentheses before each 
response, and the bubble next to the correct answer is shaded. Additional 
descriptions of the skill areas tested, more detailed test .results, and lllus- ' 
trative test questions are incljjded^ in Appendttc D of this report. 

Word Forms . Thfe 16 word form questions ^required the students .to' select the 
afJpropriate suffix (-ed, -ing, -s, -ly, -er, -est, -'s) for a word in a given • 
sentence. The members of the English Language Assessment Advisory Committee 
expected this liind of task td present little difficulty to native, speakers of 
English.- Their expectation was confirmed; on 12 of the 16 questions,' the average' 
percent scores ranged from 80 to ^5 percent'. Examples A and B illustrate two 
^'typical" word form questiojis. ' 



Example A 



0 

\ 

The explores had 


a new world. 


( y2) O discovery 
( 1) O discovering 
(95) • discovered' 
( 2) O discovers 




^ - 





Example B 



She was struggling 

(14) o wild 
(81)9 wildly 
( 3) O wilder 
((2) O wildest 



^While most sixth-grade students handled this*. type of qiiestiMi successfully, 
jnany studenjt^ did experience difficulty with a few word form items*. Fbr exaciple, 
.almost half of the sixth-graders selected an inappropriate suffix foii the 

^ ^following sentence. * • . " , 



Example 
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"That's aU he talks about/' the kids would 
'say . 

(34) o grumpy 
( 5) o grumpiest 
( 5) o grumpier 

(<56) ^grumpily ^ 



5- 
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An examination of the error pattern for Exan^ple C sHows that approximately 
one-third of the students selected "gnanpy," a wbrd that is fairly similar in 
sound to the adverbial form "grumpily" which is the correct response. After 
reviewing the percent correct scores and error pattei;ns on the entire cluster 
.of word form questions, membets of the English Language Assessment Advisory 
Coramit'tAeyconcluded that Sixth-graderS' performance in this skill area was 
consis^eyn: with their expectations, • 




Standam Usage . "Like the word form questions, most of^he 16. standard usage 
questions rec^uired the students to select the appropriate word for a giv)en blank 
in a sentence. In tJie ^standard usage area, ihowever, most of the item^ pequired 
the students to select either a verb or pronoxm usage which reflects standard 
English usage. At least 80 percent of the students selected the correct English 
usage on 11 of the 16 standard usage questions. Examples D (pronoun usage) 
and E (verb usage) arei "typical" standard usage questions. 





4 


Example D 


are aood friends. * 


i 


(90)*^ Daisy and 1 ] 




(lO)o' Daisy and me \ y 






Example E 


The doctors > "gverythipg possible. 


ft 


'(82) •did 


• 


(18) O done • • ^ 



While most standard usage questions yielded scores of 80 to 90 percent correct, 
as iti Examples D and E^, a few items, such as Examp'le F, proved to be more 
difficult for students.. ' ^ ' * 



Example F 







are throwing a party. , 




(61)0 Us girls 




(39)» We girls 




\ 





On this Question, just over one-third of California's sixth-graders correctly 
selected "We girls" instead of "Us girls" for a nominative position in a sentence. 
Since stoident performance on standard English usage questions is affected so 
greatly by the linguistic background of the home, members of the committee 
judged that the overall performance of sixth-graders in this ar^a was quite 
good. * • ^ 
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i - . - 

UnguaRe Choices. The 26 language choice questions assessed^ students' sensi- 
tivity to the special effects, created by particular word choices In written 
language. These Included (1) selecting the mosit vivid verb or specific noun 
.for a sentence; (2) Identifying attitudes conveyed by words or groups, of words; 
and (3) Identifying the- audience intended by the author of a brose passage or 
letter. * • ' . * 

♦ r 

Items which required stvidents to s'elect the most vivid verb or specific noun 
tor a sentence are illustrated. by Exanples G and H. ^ 



ts^ample G 



Pretend that you are writinq a stf)ry fill in thepval 
nnxt to the word that wifl qiyo your reader the best 
pictuio of what's happening. 



EXAMPLE- ' 
The snake 



across the qrass. 



O moved 
• slithered 
O went 



The logs on the fire popped and. 



hissed 
(31)(3trtjm5d 
( 3) O heated 
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Example H 



Pretend that you are writing a story. Fill in the oval 
next to the word or vyords that will give your reader 
the clearest,' most specific and concrete picture. 



EXAMPLE: 



At t{ie bottom of her lunch sack she found 



O some food 

a carrot 
O a snack 
O a vegetable 

rcouldsm'ell 



!. cooking^ 



(65) • bacon and eggs , 
( 9)0 a hot meal 
(10) O some good food 
(16) O breakfast . 
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While- .sixth-grade- students' pferformarice on thi language choice questions varied 
considerably from questi6n to question, improvement was shown on over half of 
the 'items, /"I 

Sometimes- iTiVritiYj|, other considerations govern the appropriateness ' of par- 
rticular word choices/ such as the audience for whom one is writing (Example I) 
and'the attitude(s) one wishe^to conv§y (Example J). 



^xan 



ixample I 



\ 



-4- 




.My dumb little brother .let my pet snake 
loose. I was ready to wring his neck. 

The writer is probably writing 

to a bufiness. s ^ 
(14) O for a science assignment. 
( 3) O to a newspaper. 
(81) ♦ to a friend. 



/ 



Example 



Which of the foilowing.best shows that Martin 
\ felt bad? . 



"I can't go to sctiooi today," Marti 



(75)^ groaned' 
( 5)o stated 
(13)Qsaid 
(.7)o^dectafed 

'■ 



Table 6 shows "that while langu^ choices was the second 'most ^iflfidult ' written 
expression skill area' for sixth-graders, .it was the only one in which the students 
average percent correct' score im^iroved mdre than 2 percentage points from 1975-76 
to 1976-77, After. reviewing the results in language choices item by item, the 
members of »the English Lan'guage Assessment Advisory Conmittee were pleased with 
the improvement shown but indicated that all' of the languagfe choice subskills, 
including sensitivity to audience, should receive continuing instructional 
emphasis, \ ^ 



3t ^ifLl 



Sentence Hecofinition. The 22 sentence Irey^ognition items required the 'students 
to discrimin|te between English and non-English word order^ identify complete 
or incomplete Sentences, recognize run-on sentences, and identify inappropriate, 
form class words. • Of these, the easies't questions were those that required th^e' 
s-tudents to recognize non-English wojrd order, in Example K. 
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Example^ K 



Fill in the oval next to the word ^roup which is" not 
a sentehce.^ 

( 3)0 The young boy wrote the story during 

the test at'school. \ 
( 4)<p Purmg .the test at s^ool the young 
boy wrote the story. 
' (88) ♦The story wcoie the young boy during 

the test at school. 
' ( 5)OThe spry was written t^y the young 
boy during the test at school. 



• 7 

The scores on the pther sentence recognition questions in this parti-cular /sub- 
skill area were ve,ry homogenfeous,^ varying onl^ from 8,6 to 88 percent correct. 

^The members of the English Language Assessment Advisory Committee have stated 
that discriminating between English ward order rfnd non-English word order should 

'be an easy task for native speakers of English, Example K illustrates that 
this was the caseifor most *(^8 percent) of the sixth-graders tested, 

• However ^ other questions in the area ot sentence recognition proved to be more 
difficult ♦for students. For^ example/ some questions required the students to, 
determine the number of sentences contained in a series of trwo or more rdn-on • 
sentences, as in Example L« 



Example L 



In the follotwing items, there are two orf 
more 'sentend^es which need to be separated 
from each other with periods and capital 
let'ters. Fill in the oval next to the 
•number which^ tells how maity SENTENCE^ 
there should be, * ^ ' 

The bus will stop on this corner my house is 
. just up the street and over the htll it's the red ' 
one. • 

X . 

( 8) 01 (62)«3 

(20) 02 . . (10)0 4 



Because of the inherent difficulty of the task in Example L, the^m^bers of the 
conknittee were not disappointed with the percent of students who responded 
correctly on this and similar items, ' 

Other J sentence recognition questipns recfuired, the students to discriminate 
between complete "land incomplete sentences* Examples K and N illustrate* typical 
performance on such items. * ' * • ' 
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Example M 




— ■ 

« * 

Fill in the oval next to the group of words which 
needs more words to make it a cohnplete. sentence. 



(12) O They brought a present, 

(18) O We are ha^py. 

'( 9) O Barry is not hfere. 

(61) • In the dark of the night.. 



Example N 




V 



Fill in the oval next to the word group which is a 
c'omplete sentence. 



( 5) O Happily skipping down our street. 
(31) •I did it: 

(20) O Happily singing and skipping down our 
. street. 

(44) O Skipping down our street and singing 
happily. ^ 



. / 



An analysis of both >of the above items and the^ir error pattern^ suggests .that 
many students relied more heavily upon the length and sound of a word cluster 
than upon its structural components in determining whether or not a sentence 



was complete* 



Table 6 shows that sixth;^gfade students made gains of .7 percent correct in 
the area of sentence recognition. Some members of the English Language Assess- 
ment Advisory Committee expressed satisfaction with student performance in > 
this area; hcrwever, a few members of the committee concluded* that oerfonnance 
,levete on items such as Example N' indicat^^that upper elementaty students need 
increased* instructional assistance in learning to recognize senten^s as a 
fundamental skill of written expression. 
- \ - 

Sentence Manipulation . On the 16 sentence manipulation, items, the students 
were asked to select the most effective Sentence or sentence eJLement and to 
expand a sentence by modifying elements* The average percent correct for this 
category was 62.6, which was *9 percent higher than the average in 1975-76. , 

There was^a considefable spread of performance (45 to 85 percent correct) on 
the nir^^ questions that required the students to select the most effective 
statement of an idea. Both the high and low percent correct scores are presen 
below in Examples 0 and P ' 
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Fill in the oval next to the seritence'which is the 
simplest, least wordy, and easiest to undferstand. 



(10)0 The popcorn was burned by^ary in the 
kitchenr * • "-^y 

(85)^ Mary Durned the popcorn in the kitchen. 

( 3)0 In the kitchen was Mary viho' burned the 
^ popcorn. ^ I 

( 2)0 Burning the popcorn in the kitcfcen was 
Mary. ^ 



Example P 



(15) O the man who took the money stashed 

tfje money in the closet. 
(45) • The thief stashed the loot in the closet. 
( 6)0 The loot was hidden by the man in a 
smalj room with a door on it. ^ ^ 
The money which had Been stolen was 
stashed'in the closet by the thief. 



(34) OT 



The English Language Assessment Advisory Committee expressed satisfaction 
with sixth-grade performance on these and, other, <^uest Ions that required th^ 
students to discriminate between clear, concise stat^ents and wordier formu- 
lations of the same Idea, The members of the cotnmlttee noted that scores were 
generally lower, on the sentence modification items th'at involved expanding a 
sentence through the use of modifying elc&ients in response to a particular 



information need. 



Such an item is provided in Ex^ple Q. 



Example Q 



A 



Fill in the oval next to the group of wotds that best 
answers the question. 



The man ate his supper. 

— " - 1 ... I ^ 

How would you change *this sentence if you 
wanted to describe How the man ate) 



(31) O The hungry man ate his supper. 
(51).*The man ate his supper greedily 
( 8) O The man ate his hot supper. 
(10) o The man ate his supper of por 
beans. 
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The^ loi/' percent correct scoires in this ^ubskill area wepok consistent \>ith the 
expectations of the English Language Assessment Advisory Committee ^since sixt^ 
graders are *sti±i developing jnaturity in theit ability to modify words and 
structures. • * ^ _ 

Capitalization ^ The 14 capitalization questions required students to recogniz 
words in a sentence that should be capitalized (such as the beginning word -of 
a sentence, names of persons^ and places, ^ays of the week, and months of the 
year). The majority of capitalization items yielded scores that were quite 
homogeneous (between 50 and 65 percent correct). Example R is a "typical" 
capitalization question, , . 



Example R 



In the following sente/ices, you are to look for mis- 
takes in capitalization. When ypu find a mistake, fill 
in the oval next to the line with the mistake. If there 
is no mistake, fill in the fourth oval. 



(59) • we ^re learning 
( 5) O about all the planets 
(15) O in our solar system. 
(?1) O (Noniistak-es) 



The members of the English Language Assessment Advisory Compittee indicated 
that they would like to see better performance 'on items such as Example R. 
however, they w6re som eidrat, enc ou-raged by the slight average gain (1,0 percent 
correct) that was made in the area of capitaiizatidn, 
/ • ,^ 

Punctua^tion , There was almost no change (.1 percent increase) in the area ,of 
punctuation', which continued to Ji^ the ^most difficult skill -area for sixth- 
graders with an average 'percent, correct score of 52,5- The 18 punctuation 
questions required the sttidents to recognize errors in the use of the period, 
question mark, exclatnation p^nt, comma, apostrophe, and quotation marks. 
Examples T, and U illustrate the raige of student performance on the 
punctuation items . ^ " * 



Example S 



The following sentences may have a iristake in 
puhctuatiom (periods, commas* apostco^jnes,. etc.). 
When you find a mistake, fill in the oval next to the 
line with the mistake. If there is no mistake, fill in 
the fourth oval. * 



iA) O My favorite snacks, 
( 7) O to eat after s^ool 
(75) • are oranges a^les and peanuts. 
■ (l4)'OjNo mistakes) 
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Example T 



4 



( '8)0 Fjihing for bass can be plenty 
(56^4> of fun but I- would rather go 
( 8)0 swimming when the day is hot. 
(28)0 (No mistakes) ► 



Example U 



(17) O "Run, Pedro, run!" we 
(13) O shouted. But ^edro acted 
(32) • as if he hadnt heard us. 
(38) oC^o "^'Stakes) 



\ Members of the committee expressed continue^ concern over sixth-grade 

pe^rformance in the area of punctuation, since the mastery of ^uch "basic skills 
is important if students are to proof-read their own writing effectively., 

■ ■ . ■ • ■ - ■ 



) 



V 



J - 
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Written Expression Repults 'for Grade Twelve 



'fest Scope 



The written expression Section of tt^e^ ^rvey of Basic Skills: Grade 12 
consists of 142 questions. The 'items were selected to assess a wide variety 
of objectives compiled by the English Lan^age Assessment .Advisory Committee 
and published in Test Content Specifications for the Survey of Basic Skills ; 
Written Expression and'Spelling, Grades Six' and Twelv& . Both 'the dbjectives 
and the items used t6 assess the ^achievement of the objectives fe)fl into one 
of , six major skill areas: woril forms, language choices, sentencfe recognition, 
sentence manipulation* paragraphs, and capitalization and punctuation. The 
emphasis placed ^upon each of the skill areas in the Stirvey of Basic Skilla: 
Grade 12 is shown in 'figure ' z S * 




4^ 



Fig. 4. Number of questions, by M\\ area, intiie wriMen expression section of tlie Survey of Basic Skills: Grade 12 
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Codparlson of 1975*76 and 1316-11 Result. Grade Twelve ' " ^ 

The results of twelfth-grade- students/ petformance oil the total written expression 
test and in eacfTof the skill 'areas for 1975-76 and 1976-77 aife presented in 
I Table 1. Year-to-year changes in overall performance and in skill area perform- 



ance ape .also s^^own in the table. 



r 



• - Table 7., ' 

Written Expression and Spelling Performance of California 
Twelfth-Grade Students on the Survey of Basic Skills; Grade 12 



Skill area 


Number of 


. Average percent , 
^:orrect 


Gain (+) 
in 


or loss (-) 
score - * 


questions 


•1975-:^6 


1976-77 




-4 


-2 0+2 +4 


TOTAL WRITTEN 
EXPRESS lOR 


(142) 


' (62.3) 


(61.9) 


/' 

(-0.4) 








Word forms 


^4 


72.6 


72.1 


-0.5 








Language choices 


32 


66,. 9 . 


66.7. 


-0.2 








Sentence recognition 


20 


67.3 


67.7 


+0.4 








Sentence manipulation 


12 ' 


42.9 


42.9 


0.0 








Paragraphs 

•f • ' 

,Capitali.2;ation and 
punctuation 


26 


59.9 


59.1 


-0.8 




■ 




28 


54.6 


54.3 


-0.3 








, TOTAL SPELLING 


(72)" 


(68.0) 


(66.8) 


-1;2 ■ 




- 





The data in Table 7 show that the performance of twelfth-grade students iiyX 
written expression declined slightly. Slight decreases were noted in all of 
the s khl areas except sentence Recognition and sentence matlipulation. 



, Discussion ^aYid Analysis, of Skill Area Results^ Grade Twelve 

Members of the English Languages Assessment Advisory Committee reviewed the 
1976-77 twelfth-grade written^xpression results, as they did for grade six. 
The committee members again f^ged, the adequacy of student performan^ in 
light of the inherent difficulty of each skill, the particular items used to 
* assess each skill, , and ^changes in performance from 1975-76 to 1976-77. 

Actual test^ questions are presented in the following analysis to de*scribe the 
skill areas ^s completely as , possible 'and to illustrate the committee's conclusions 



Written 
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about twelfth-grade students' performance J^i Nwrltten expression. For e.ach 
example the percent of students who marked each* response is indicated in ^ 
parentheses before each response, and the bubble next to the correct ^swer 
has been, shaded, - Appendix E contains additional descrif>tions of the skill 
^ areas t^s^ed, more detailed test results, and Additional illustrative test 
questions.' ' . ^ 

' yord FVms.^ The 24 word form questions required the^ twelfth -graders to perform 
a variety of operations with words. Eleven of the items asked students to 
select the form of the word that was grammatically correct in a given sentence. 
The vast majority'of twelfth-giraders successfully handled items of this type 
as shown in Example A* ' , 

t : \ 



Example- A 



Select the form of the word whfch best com 
pfetesthe following' sentence. 

The girl did her work very T ^ 



( 1) O cheerfulness (, 6) O cheerful 
(9?).^ cheerfully ( 1) O cheer 



In spite^ of the fact that scores declined in' this' subskill area, the conmittee 
judged that' twelfth-gr^defs were still demonstrating mastery in the placement 
of^f fixes. The committee also noted that twelfth-grade perfomange was 
stabl^ on items requiring students to discriminate {jetween form class words and 
structure words. Example B illustrates this.subskill. 



Example B 



For the following items, select the one word which 
DOES NOT belong with the others. ' " 



(85) • hand 
( 3) Oand. 



( 6) Oihough 
( 6) O.fo^ 



Of greater concern to the committee, howeVer, was twelfth-grade performance 
on a variety ol dictionary usage questions. Example C is a tyt)ical dictionary 
usage item. % , '' \ 



S'7 
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Example C 



J. 



"-:e3d the dictionary ^ry below and answer the 
iOialed questions. ' 



cop • per (kop'er), a [AS. coper, coper, fr. L. 
cuprum.^i^ Cyprus, anciently renowned forjts. 
^copper mines.] .1, A common metal, reddish in 
color; *an,d one of the best conductor^of heat 
and electricity. 2, Something- made >m copper: 
a copper (or bronze) coin^a large bx)iler, as 'for 
laundry or for cooking (now usually made df 
iron).. 3. The color of copper.-i/. t, 1. To cover,, 
' coat or sheathe with copper. 2. U.S. To bet 
against; - orig. used in faro. - cop • per.^adj. r 

• The dictionary entry above indicates thu: 
"copper'; should be pronounced with the sires 

( 9) Oon both s^/llables. 

(69) •on the first syllable only. 

( 4) Oon the second syllable only. 

(18) Obetween the first and second syllables. 



As- the item data reveai, 31 percent of the studei^ts failed , to determine from 
a pronunciation key which syllable, in a word should ^receive the stress • The 
scores on items such as Example C led the ilnglish I^guage Assessment Advisory 
Committee to conclude that additional instructional emphasis w^ich woul<t<nable 
students to tap the full resources of the dictionary is needed 3at the ^ebdndary 



level. 



Language Choices > The 32 language ch^e questions assessed the ^^dents' ^ * 
.sensitivity to the* effects of particii^r word choices in a variety of contexts. 
Thirteen of the questions required the students to identify the attitui* or 
tone conveyed bywords, sentences, and entire passages,, Student performance 
on these questions ranged from a^low of 30 percent correct to a high of 84 
percent , correct. ' <. ^ ' . * 



Example D is a typical^ 
correctly r 




Sge dioice item that m^t twelfth -graders matjced 



Example D 



^ Which 0^ the tallowing words conveys a' 
• • NEUTRAL meaning when describing a person's 
acting ability^ • \ . 



(10)0 ham 
( 3)0^ar 
(81) ^ijerformer^ 

( 6)OrMus 
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Some Items required the students to make finer discriminations than that requ 
in Example D «nd were consequ^tly more difficult. " Lesa than two-thirds of th 
twelfth-graders selected the best langjuage cti^>ice on the following question,* 



Example E 



* 'A 

Or Henry J Mpimhch, at Jewish Hqs 

pital in .CihcmnatT^escnbed the technique in 
the, journal Emergency Medicine and invited 
physicians to try it in real emergencies. 

Whiqh of the following terms is most respectful 
in Jhe context of the above sentence? 

(62)^^directorof surgery .* 
( 1) Ochiaf blade 
(17) O practitioner 
(20) OheiO doctor 



Students encountered even more difficulty, on items that require^K tliem to "go 
beyond" the literal meaning and distihguish between- the attitude "Of the writ,er 
and tHe attitude of the character being described. Less than one-third of the 
students wete able to handle the discriminating task presented in Example F, 



Example f^, 

f 



' ' Pledgeby knocked and rang, afid Fledgeby 
rang arrd knocked, T3ut no pne came/ Fledgeby 
crossed the narrow street and looked up at the^^ 
'house windows/ but nobody looked down ^t 
Fledgeby. He got out- of temper, crossed the 
narrow street again/ and pulled the housebell 
^ as if it were the house's nose and were taking ' 
hint . from his late experience. His ear at the 
keyhole seemed, th^n, at l'ast/,4cr give -him 
assurance that something stirred w^in. His eye 
at the k'&yhole seemed tb confirm his ear, for. he 
^arrqrily pulled the house's Dose.again, a'hd pulled 
' and pulled and.co'^ntinued-to pull, until a human 
""TTo^ea p peared "trrthrdarkxtoOFrwayr - " - " - ---- - 



Which «of: the following" words be'st describes 
tne att-itude of the writer.toward the incident 
he IS describing^ . . 

C 7) O disapproval (e2)0 anger 
( .1) happiness (30)* amusement 
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An analysis of 'the error pattern on the above, item suggests that the majority 
of the students miscued on the underlined sentence (emphasised here or the 
reader's i:onvenience) , which described Fledgeby^s attitude rather than that of 
the writer* In so doing, they overlooked the subtle atausement cojiveyed by the 
author with a variety of word choices throughout the passage (such asy "the 
house' ^ nos^" and ''until a human nose appeared in the dark doorway"). C Thfe * 
members of the committee concludedT that stydents need inc/eased iustrubfeional 
assistance in learning to recognize how word choices can bej manipulated to • 
convey pairticular attitudes in writing. . ; ' ■ . 

Ten of the language choice questions requiijed the students to determine the 
mcfst .specific oi general word from a list of semantically related words* .The 
members of the' -English Language Assessment Advisory Committee noted^ that the 
performance of twelfth-grader^ in this area continued to be disappointing* 
Examples G and H illustrate an easy and a difficult question, respectively. 



Example G 



^ Which of the,folloWing is^the most GENERAL? 

(' ^)0 sports car ( 6) O sedan / 

(11)0 bus . (79) •passenger vehicle 



Example H 



iM^^p^if^y thf} cl^^cirt\$t, most specific statemr'.t 



.(12)0 
(I5)0 

(43)« 

.(30)0 



James Baldwin's Go Tell It on the^Mourh' 
tain is a novel of Harlem ghetto life. 
James Baldwin's Go Tell It on the Moun- 
tain is a' novel about a family in the 
Harlem ghetto. f 

James Baldwin's Co Tell It on the Moun- 
tain is a novel of the Grimes family in the 
Harjem ghetto 

JanYes Baldwin's Go T^lfjt qn the Moun- 
hfn is a thundering novel -ciepictirig 
Karlen^ o!-ietto life. ^ 



Student performance in this skill area is a matter of concern because if y 
students are not able to recognize the difference between the general and . 
specific in language, in Example H*, for instance, it seems 'unlikely that 
they will be able to achieve appropriate levels-vof specificity in their own 
writing, ' ^ ^ ^ * 

Another key factor in determining^the effectiveness of particular language*' 
choiceis in written expresrfion^ls an awaren^s of the communication needs ^ ' 
the audience. Thus, a cluster of questions .required the students fto ide'i^Tfy 
the audience intended by the author^of a particirlafr paTssage. On four of^ the 
five items measuring this skilj., scores ranged from 82 t<:^96 percent correct. 
Example I i^ustrates a typical '>udi^ce" question. ' ^ ^ 
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* ^Example I The public school is taking the rap for soci- 

ety's ills. The basjc institutions of society are 
home, schopk and church. There is widespread 
denigration of religion; the home has been frac- 
tured by television, lowered standards of c6n- 
■duct, compromised moral values, a preoccupa- 
tjon with matenahsm, ^hd working mothers. 

Today's- parents have declined their responsi- 
bilities in favor of Dr. Spo'ck. child psychologists 
^and a host of liberal freethinkers. They send 
their children to school ill-mannered and undis- 
, ciplined.' They canriot 'openly face the fact their 
children d^iinot learn' because of the tvay they 
were initwily raised. 

School -IS the. parents' last resort in a vain 
2ttj|<fct to instill values that should have been 
tdugnr at home. Schooti have not failed. Parents 
nave 

* The letter to the editor is really intended tc 
re^ch which of the following audiences? 

( 3) Q the editor of the paper 
i ^)Ostudetits - 
(•2)oDr. Spock 
, (91) ^parenis 



6 



As a result -of the higfi percent correct scores on such items, the members of 
the, English Language Assessment 'Advisory Comml^ttee 'were generally pleased- with 
twelfth-grade students' performance in this important subskill 'area, 

Sentence Recognition . The^O sentence recognition questions assessed students 
aWareness'^-of sentences, sentence patterns, pafallel structure, ^ and subject- 
verb agreement. The percent correct scores varied with the difficulty of the 
question. For exampi^e, ^most all the students ','(86 percent) successfully 
identified the incomp;lete 'sentehqe ift Example J. q 



Example^ J 



Identify the group of words t^^ch*'is/ 
inc{>fnplete or« needs ad^ditional" words to 
coftplete. ^e mefening^ 

^ ( -3)0 SamjfS always hungry :\ 
*" (87)^ TheTiurried sounjJs of footsteps. 
( The player.tnocked him do(vrt. f: -^ 
( 4)0 He crashed through the door. > 
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However, fewer students accomplished this -task on' thf';more discrinrfnating qOestion 
below. • ■ J'. ■ f 



Example K 



Idenufy tht* group olf words which is irtco:^: 
plete or needs additiorfal words to complete 
the meaning. ' , 



(69) 

•The barking dog in the driveway. 
( 6) Olt is humid. ^ 
(20) OPeace continues. 
( 5) OThere is the nail. 



V 



The error pattern for Example K suggests that many students relied more ' 
heavily upon the length of a yord cluster* than ftpon its structural components 
in determining whether ^a sentence was complete or incomplete. It may hk that 
insensitivity to the grammatical structure of a sentence contributed to ^ 
the confusion displayed 1^ students on the' following quest ion ^as well. 

^ < 



Exaipple L 



Identify the group of words which DOES NOZ 
correctfy complejte'the following sentence. 

» 9 

Each of the men C : : 



(22) Ohas his work cut- out f6r him 
(170 Oshows great talent 
(19) Owtshes for a chance to perforrh 
(42) •have mu6#k^rj< to do 



Example L^lnvolved selecting a verb that would in rftmbfer with the' subject 

of the sentence. The success of students in doing so/ MW^er, was dependent % 
upon their first recognizing the wofd "Each" ^ the -su'bject of the sentence, 
Manx of those who sele^'cted the incorrect .options (58 percent) may haye incorrectly 
perceived^Wn" to be^the subject of the sentence. * 



The members of the English Language Assessment Advisory Committee judged that 
twelfth-grade sti/dents' performance on the item in Example M also reflected a 
lack of ai^iytical awareness ofSs.entence structure, , " jiL' 



Example M 



Select the sentence which follows the basic 
payern of the. model. 

Model: The test, although lorjg, was^easy, af 
least for tho^e who had studied. 

( 8) OBill frnished the typing job, even though he 
had to^work through lunch to complete it.- 
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Example M 
(cont . ) 



(24) OAlthough- the typing job was long, it JWas 
• not complicated, so Bill stayed to finish it- 
0 during his lunch. 
^^^)|*The typing job, though nojt dffficult, was' 

* ynusually fong, espetially for Bill. 
(22) OA long but uncomplicated typing job was 
completed by B^ill". 

! . 



The above item required the sTtuifcnts 'to identify the sentence that was parallel 
in/structure to the model. Because of the difficulty of the ta^k, the English 
committee members were not surprised that only 46 percent of the students marWd 
thfe question correctly. Moreover, the committee members were encouraged by the 
larger proportion. of students who successfully rejected the nJnparallel structure 
in the fallowing item* ^ ; V. 



Example N 



_W/Jiicbk^rase CANNOT be used to complete 
the senteht^fi? 

Mary most enjoys playing the flute, writing* 
poems, dancing fast, and ^ 

(»8)0 dating her many admirers 

(lO)O going o.ut on dates " •* 

(75)^ to go out on dates 

( 7)0'having men^ask her out ' - 



After reviewing twelfth-grade performance on the,entire .pluster of* sentence, 
recognijti'oij items, the members of the English Language Assessment 'Advisory 
Committee concluded that twelfth-grade students' performance was generally * 
Btron^ on most of tTie*basic sentence recognition and subjefct-verb agreement 
questions even though many students weref insensitive to the g-rammatical strubture 
of sentences* ^ * . , . 

• " . > . ' : ■ . ^* ' ^ 

Sentence Manipulation^ The 12 sentence manlpul-ation questiqns required the 
students to perfonti A variety of mental operations with sentences* 'This partic-r 
ular skill 4rea» remai-ns ai the most difficdlt one in ^written expression for 
twelfth-graders with an average percent correct: score of 42.9* Six questions ^. 
'required the students to^ select the most effective statement of ah idea.. As. ' 
was noted in paist years, twelfth-graders consistently rejected terse, economical 
statements in ^avor of wordy expfessions of. the sime idea. , Example 0 illustirates 
this problem. ' - . ' » ' 
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Example 0 * 



Below^are four sentences, expressing the same genor.^ 
thought. Mark the sentence which expresses* • 
thought MOST EFFtCTIVELY. 

« 

(50)OShe spoke to me in a ver'y c'ool manner 
when we met each other yesterday. 

(12)OWhen we met yesterday, I was spokan to i^^ 

a very cool manner by her. 
f 

(15)OHgr manner was very> cpol when- meeting* 
- and speaking to me yesterday. 

(23) •Yesterday she greeted me coolly. , ■ 

i 1. 



Apparently, over three-fourths of California's twelfth-graders equated effecti\ 
ness with the wordy, passive^ 'and/or awkward statements. 

The students also encountered difficulty on a variety of items that required^ 
them, to identify .the sentence that^most effectively combined several pieces of 
information. This .t^^e ^or sentence-combining task is illustrated by Example P. 



Example^ P* 



1. Ships' logs bring back t^e danger of the 
wh^liVig voyages. 

2. Ships'* logs bring back the monotony of 
the whaling voyages. 

3. Ships' logs bring back the occasional excite 
ment of the whaling voyage^ 

4. Snips' logs' were usually keptNpv the'first 
/rnate. ^ 

Wtjiich of the following sefitenceS most effec- 

• tively combines the information in the above 
%ur sentences? * 

J* 

(23) OShips' logs bring back the danger, monot- 

• 'ony, and occasional excitement of the 

. whaling voyages and were usually kept by. 
the first mate. ^ 

( 9) OShips' logslDring back the whaling voyages 
and the danget, monotony, and occasional 
excitement, usually kept by thfe first mate. 

(59) •Shipsi logs, -usually -l^ppt by the first mate, 
bring bacj< the danger, monotony, and 
occasional excitement 'of the whaling; 
voyages. ' " 

( 9) OUsi^ally kept] by the '^first mate of the 
'whaling voyages, ships' logs bring back the 
danger, monotony, and occasional excite ' 
ment , \ 



^9.- 



While the above question pr&ved to be somewhat easier than that in lixainple 0, 
over 40 percent of the students still failed to select the most effective 
statement. 

i^nother sentence *manipu la t ion task required the students to manipulate sentences 
so as to achieve a particular relationship between them. ^Example Q is such an ♦ 
item. ' \ ' ^ v 



Example Q 



The foljo\Aihg two sentences Can be 
L)incd in a number of ways: 



:om 



A. .You can call Mr. Brown for a recom 
mendation. 

B. Mr. Brown is the owner of the B & B 
Y Market. 

Which of these cocnbinations reduces sentence 
B to a modifier? 

(55) •You can call Mr. Brown, owner of the B & 
B Market, for a recommendation.. , ' 

(11) OYou can call. Mr. Browrj for a' recommenda- 
tion; he is the owner of the B & B Market. 

(6)0 You can call Mr. Brown for a recomrnenda- 
tion; because he is the owner of the B & B 
. Market. , ^ 

(28) O Vou can call the owner of the B & B Market, 
Mr. Brown, for a recpmmenclation. 

^21 




On- the 12 sentence manipulattio'n i,tems (illustrated by Examples 0, P, and Q) 
scores ranged from 23 perceiit correct to 59 piercent cdrrect!' Thus, the members 
of the English Language Assessment Advisory Corami^ttee^ cfoncluded as they did in 
past years, that California's ,twelf th-graders need more experience with sentence 
inanipulation activities in 'ordjer to help them (1) le^rriyto equate effectiveness 
with economy of expression; and (2) gain control o£ sentence structure in 'their' 



own writing. 



Paragraphs . Twenty-six questions required students^to perform a variety of 
mental operations on still larger ylnits of discourse such as para^raph^ and 
passages. As one might expect, th^ paragraph skill area was one of the - most 
difficult portions of the test; the average. peMpent correct . scoife" for this 
area was 59.1. Again, performance varied with the dif ficulty/ o'f the' subskill 
and with the particular test iteu: assessing it. ^ , ^ ^ 

One cluster of^^qiJ^tiona th^t most'^itfudents handled successfliliy involved , 
iden't^ying irrelevant material in a paragra?ph. Example R illustrates both ' 
the nature of- such a task and the irypical level' of mas^tery in thi^ area. 



?5- 
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(1) During the present century, our country has i 
made tremendous progress in helpfng people 
to live healthier and longer fives. (2) We have 
more college graduates* now than ever before, 
(3) In 1900, a 10-year-old child could expect to 
live until he was about 55 years old. (4) Today, 
a 10-year-old can expect to reach the age of 75. 

(5) During most of their lives, .people are 
generally much healthier than they used to be. 

(6) Since people are now living longer, however, 
it is only natural that more people suffer from 
Illnesses thai come with o*d age. 

Identify the sentence which is unrelated to the 
others. . ' 



01 
( 2) 



• 2 

(92) 



( 2) 



05 
( 4) 



The members of the conmlttee were pleased that In most cases the maiorlty of 
twelfth-graders could tecognlze sentences that departed from the primary topic 
of a paragraph. Moreover, the^ members of the committee judged that twelfth- 
graders; had maintained a satisfactory level of performance on questions requiring 
them to Identify the most effective summary statement one or ^ore paragraphs. 
Example S is a typical Item of this nature. 



^ Example S 



• 4, 



ERIC 



-1 

A suddgn, sharp bear-hug is saving the lives of 
people starting to choke to death on food. I.t is 
also rescuing some drowning victims. 

-The pressure from the hug ^causes food "to 
pop outJike« cork from a champagne bottle/' 
says the'surgeon who developed the technique. 
When a|l)pfied to drowning parsons, "the water, 
gushes out 6f the mouth." ^ 



Dr. Henry J. Heimlich, thje director of surgery^ 
at'JejA/i^h Hospital in 'Cincinnati, described the ' 
technique in the journal Emergenc]f Medicine, 
and invited physicians to try it in reat emer- 
qencies. ^ -^ ' " 



H^ obviously couldn't test it 'on ljumaVi's by 
p.uttin^ them into danger, but he had shown the* 
• method workeci on laboratory dog^. 

Now he has some thirty letters telling of lives/ 
apparently saved-a peppermint dislodged from 
the windpipe bfv'a twenty-two month old, a 
prece of roast beef ^from the throat, of a nin^- 
year-old girl, a Korean ^woman saved by a U.S. 
Ai'my medical corpsman in,iJCorea. 



Example S 
• (cont . ) 



Written Expression Results, Grade Twelve 

Select the sentence bel^ whiph most eftec- 
tively summarizes the first two paragraphs. 

•a sudden, sharp, bear-hug can help save the 
lives of people choking on food or, some- 
times, of people drowning. - 
(20).Olf you squeeze people who are choking on 
food or .drowning, the food or the water 



(12) 



( 3) 



gushes out "like el cork from a champagne 

i 



bottle." 

OA surgeon has developed iechnifeues for 
giving a bear-hug to peopte who areN(:hoking 
on food. 

OSome people' who are drowning may .b$ 
saved by a quick, bear-like hug. 
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As the item data reveal, 35 percent of the students incorrectly selected either 
the overly specific and. less important statement in the second option or the 
less compr ehensive statements in the third and fourth options. 



Another important skill in writing paragraphs is the ability to put sentences 
-into a logipal^rder so as to signal sequences in time, action, or logic. 
Example T is a question that assessed this ability. . ' . ' 



' Example T 



The, following' paragraph may not b^p a logical 



S'-iquence. Read the sentences and seflp 
order'fdr them. - 



the best 



n) Rain.^ scooped by the violent wii5d, pelted 
against my bedroom window. -(2) The wind 
howlad and, swept around, the coriieV^of our* 
house.' (3j I (lay alone in 'bed frightened by 
what was happening' outdoors. (4) Outsiijle it 
was a dark and stormy night. ' 

( A) O Correct as is (76) • 4, 2, 1,3 
'(15)03,2,1,4 ( 5)0 1,2,4,3 . / 



Given the difficulty of sequencing tasks, such as that in Example T, the 
members of the English I^nguagie Ass^s^ept Advisory Committee concluded that 
the performance of twelfth-graders was fairly good in this' area. * ^ 

The committee members were' not as'^ pleased, H^evet, with the percent correct' 
scores on questiqns that required students to^fc4en'tify words serving as 
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transitional elements within and between paragraphs • 
typical perf c^^nce on 'thils kind of task. 



Example U illustrates 



Exaiaple- U 



/ 



1?C 




The seven sentences below are in a scrambled order. 
Some of them can be put together to make a single, 
unified p^ragrap|h. Before attempting to answer any 
questions, read all of the sentences carefully. 



1 It probably received its name from its 

2 copper-colored head which is triangular 

3 in shape. 

4 Like the rattlesnake, it is aonember of 

5 the pit viper family h9ving a hollow or 

6 pit between the eye and the nostril. 

7 The copperhead was once the most comnion* 
8j^nd widely distributed of all venomoys,^ *» 
9 snakes in the United States. .a' . ^ 

10 This may be the reason that DemocKats'in^ 

1 1 the North who sympathized with the Soutl¥^' 

12 in the Civil War were called '/copperheads/' ^ 
^13 for they were suspected of treachery. / 

14 Unlike the rattlesnake, it has no rattles' 

15 and strikes without warning. 

16 Augustus Thomas wrote a full-length drama 

17 that he called The Copperhead. * 

18 Today, however, it is most frequently 

19 found in sparsely settled ^reas of the / 

20 South. ' ' 



Which of the, following words serves as a trar- 
tional word in thfe paragraph? 



' (15)Qwhich (line 2) 
(13)Orattlesnake (line 4) 
(18)Ocopperhead (ITne 7 
(•54*),^however (line 18) 




As the item data reveal^ almopt half o^the twelfth-graders either did not know 
th^ meaning o£ the term "ttansitional" or coul,d not apply the concept when asked 
to tdeTlt.lf7^raTisi1:ional^ordk in a paragraph. On the basis of twelfth-grade 
performance <jn th*is Item an/i others like it, the members of the^ommittee ^ 
«conclufi^d that students may need increased Instructional emph^is the use . 
of transitional words in jtheir own writing* 

The percent correct scores were even l^ower on several questions that tested 
^students' awai^eness of inconsistent Verb tense from, sentence f« sentence. 
Example V il/lustrates this weatcness* 



ERIC 
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Example V ^ 



1) Winters are more severe in the high moun 
tains than they are*at lower elevations. (2} T%e 
vHrst fcpst comes earlier in the fall. (3) Qften, a 
mankef of snow covered the high {Deaks. (4) As 
soon as the danger of frost is over, crops such as 
corn and tobacco may tfe planiec) on the moun- 
tain slopes. that are suitable for farming. 



Which sentence does not agree with the time 
pattern of the rest of the paragraph? 



( 7) 



02 
f22) 



• 3 

(28) 



0'4 
(43) 



The members of the Englishj^^angtiage Assessment Advisory Committee concluded 
that the weak pei^f ormance of students on this kind of task reveals a lack of 
iinalytical understanding of structure ^s it relates to time patterns in paragraph 
development. * ° . ^' * 



Punctuation and Capitalization . Twenty-eight questions* assessed the students* 
awareness of errors in punctuation and capitalization. This was the second ^ 
most difficult skill area for twelf th-graders^^ §^ the averaWe *t)erQent correct' 
score of 54.3 reflects. The percent correct scores on individual items varied A 
considerably, howeveu. For instance, a majoi;ity of the students marked the * ^ 
correct response in Example , ' 



Example W 
i 



In the followinq senterf^es which punctuation is 

0 

needed^ ' * - ' 



Wa vfsitod Taliesen West Frank Lloyd Wrig' 
famous hpme in the desert. 



thtv 



(76)^ West, Fj-ank 
(15^5 O visited, Yaliesbn 
C 2)0 f^ious,, home 
C 7) oJfce, m ^ 



The memlKers of the English .Language Assesstfient Advisory Committee obsetved that 
wh^ere punctuation coincided with the* natuVal junctures, of spoken English (as 
in Example W)', many 'students; performed successfully. Howeyer, whejre students 
had to use knowledge of a conventio^n as a guide rather than the sounci of oral 
language, tKe perc^t corrfecC scores dropped, as is illustrated by the apostrophe 
item in Example .X., ' ' ' > * 

. ' ■ ^ ■ , ■ . 



9 
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) 



Exampl 



e X 



1 ^^"^ ~ 

^ 1 More people know Lewis Carroll thdn 

2 * Charles Lutwidge Dodgson, although 

. 3 ^both of these names belonged to the 
4* same man. ^ ' ^ , 

B 5 He graduated from Oxfonlin '1854 and 

6 began Jeachirig mathematics there the 

7 next year. 

C 8 During the' twenty-five years he served 
' 9^^'as a lecturer in mathematics at^xford, 
. 10 he wrote suct^books as A Syllabus of 

11 Plane Algebraical Geometr^ and Skat?- 

12 fyolic Logic. ^ 

D 13 But, It was as an ajuOior of children's 

14 ' books tW he won hisTame. 

E 15 His booW Alice in Wonderland and 

16 Through nhe Looking Glass, are known 

17 the woria over;, and have been trans- 

1 8 lated into many languages. 

F 1'9 These books a\sy contained many 

20 humorous poeras^ch asJabberwocky, 

21 a poem containing words/ that haxi 
. 22 never been used before. 

G 23' Childrdh were loved by him, artd he 
24 knew and understood their world of 
" 25 imagination. > 

Ik 

J ' ; • . ^ 

, ;Which is the correct way to write the last wor 
^of line 13? , 

(46) •children's (28) Ochildrens'^ 
( l)Ochllds (25)'Ochildrens' 



/ 



/ 
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VI. Mathematics Achievement for Grades Six and Twelve 



^ Synopsis of Findings 



Compared tjg the 19 75-76 re sults, the overall achievement scores in mathematics 
^during 197or77 in Calif ornia^pubTic schools Jbiproved slightly in grade six and 

declined slightly in grade twel,ve. The results from^'the norming studies \showed 

/that the score of the sixth-grade median student improvecf in 1976-77 by one pei^- V 
f centile point and now ranks at the 51st percentile--one point above the national \ 
.average. The score* of the twelfth-grade m^ian student declined by one percentile 

point down to the '43rd percentile — s^ven^ points below the national average. 

Sinc^ 1^74-75 the Mathematics Assessment Advisory Committee has been asked to 

review the, .statewide results and to "make suggestions for improving the quality 

of mathematics- programs [in California. Although the discussions , in this chapteK . 

<?n mathematics achievement refleat the judgments of t*ie Mathematics Assessment 

Adv:^ry Committee, the Department of Education ||^sumes the responsibility for 

the contet^jts of this report. ^ \ . . . 

The 1976-77 resujts on the Survey of Basic Skills; Grade 6 revealeji some- sighif- 
icantf patterns when they were compared to those of ^975-76. The committee noted 
an improvement, of spores *ln those areas that are -generally considered most impor- 
tant; for exfample, in computation and applfcat-don-related. skills involving whole ' 
numbers. Also, the scores in -the area of computation wi^h decimals and decimal^ 
q^plications and the scores in measurement skills continued to imptove. The 
improvement in decimals seems to reflect the increased emphasis on the topics 
recommended in Mathematics Framework for Calif orniaJPubli? Schools! Kindergarten 
through Grade Twelve (Sacramento: California State Department of VEducation, 1975) 
arid the use of the new instructional maferial^ that yere selected on the l^asia o/ 
the criteria ^n that framework. Achievement inJ computation and a^lication- i 
i*latedvskills with fractions declined slightly *iA 1976-77., reflecting the de- 
creased emphasis in this area as recommend ed?in Mathematics Framework for 
^ California Public Schools . , The scores -of s^ixth- graders in the area of probability 
and -statis tics imn«*oved slightly, but they were stiXl fudged to be too low. 

Th6a|^ialysis of l^e results on the Survey of^asic Skills ;^ Grade 12 indicated 
thaW^elf tb^raders continued to perform at the same level as in 1975-76 in the 
area of whole jiumbers , fractions, and decimals. Indeed, the committee felt that 
further improvement in these areas would be diffica:|.t to attain since the general n 
. math ^skills a large number of high school students are not reinforced in their 
high school /ears. However, thfe 1976-77 scopes didj show' l^gnif icant improv^ement 
on Ihos^uflfetions that, reflected realistic, lif e-like\situations . Achievement 
in basic ^ln.l^s related to algebra, geometry, measurement, and probability and 
statistics decreased slightly.^ • ^j" ' * 
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■Jh^^arth€mat-t€& A ss e se m e n fe Advi rso^ - ootDm i fe tee reconmiei^ed^-feheT^ollowing f<y£- 
Improving matKematics achievement: * 

i . ■ ''^ , ■ 

Increased Instructional .emphasis at all gfaSe levels on basic 
• ^ geometric relationships as they ap|5ly to praS^tical situations; 
'/ particular emphasis on the'' development and ujse of spatial re- 
lationships 



2. Continued enjphasis in grades three through eight on decimal notation 
and dectoal <:omputatioh--skl'll-s-" - , 



3. Increased emphasis at all grade levels on instruction in 'the use 
and understanding of basic probability and statistical terminology 

4. Continued strong emphasis at all grade levels onjthe fundamental 
sjcills and -concepts of measurement • \ 

5. Increased emphasis at all grade levels on the* skills needed Ifo read 
and comprehend technical' materials related ^t-o mathematics 



I- ' 



^2- 




Mathematics .Results for Grade Six 



Scope [ot the^ Grade gix ISiirvey " * . , . 

The 'Surrey of '^Basic SkllR^-Grade 6 was.^developed specifically to assess 
mathena^lcs skills taught througn the 'sdxth-gr^de level In most California 
sc^ols. The 16G miestions^on- the. Survey. 'yere^ designed to assess stuclents' - 
sk±M.s in the area^ of AitMaetic, geometry, - measurenient, apd probability and ' 
statistics. Fi^ute 5 illu^ra^tes the .enphasis placed on each skill area in the 
► totaL test-; In the figure the skill ax,ea of arithmetic, ia subdivided into number' 
concepts, whole numbers; fractions, and decimals. fKe emphasis on each area 'in 
the test is consistent with the ^neral Tnathematics curriculiin of most California 
schools and the recommendations fli Mathematics. Framework for California Public > 
Schools , A detailed description of the sjtlils ass.assed* in ^tfe Survey is giVy 
in TestjContent' Specifications for the Surveji of B^sic gkllls; .Mathqiiatics, Cracfes 
Six and Twelve (Sacramento; California State Department of Education, • 1975),. 
Additional defscriptiohs of . the major skills assessed in the Survey and exMple 
test' qu^tiona are IncJLuded' in App^lx F of thia[ report. - • . . 



Arithmetic 




Fig. 5. Skin area efnphMts m 6e Survey ofBaskJSi^ 
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^lathematlcs Results^for Grade Six ^ • . " » * 

Table S'-shcjws the mathematics achieveiaent results of California sixth-grade 
students on the 'total test and in the skill areas for/1975-76 and ,1976-^77. The 
stable also shows the conges in .s cor ear from 1975-76 to 1976-77i A detailed , 
breakdown of skill area results is given in Appendix F. • 



Table 8 



Mathematics PerfcTrmance of California ^ixth-Grade Pupils 

" , on the Survey of Basic Skills; Grande 6 • ' ^ 



V 

Number of 
questions 



Skill area 




Average- percent 
correct 



Gain(+) or lossC--') 
in Score 

-4- -2 0 ' +2 . +4 



TOTAL MATH 
Arithmetic 



Number poncepts , 
vniole numbers / ' 
" Fractions 
Decijial3 

,Geometry ° ^ 

Measurement and 
graphs. 

Probability a^d " 
statistics * 



2ff 
. 28 
20 

.> 20^ 

2q' 

* 

32 



12 



69.4 
66.9 
49°. 6 
56.3 

58.8 



52.1 



40.4 



65*. 5 
*67.5 
49.0 
.57.8 

58.5 



53.5 



40.9 



+ ;3 

0.0 

+ .1 
+ .6 

- .6 
+1.5 

- .3^ 
+ .5 




In Table 8 the scores and changes 'In scores are expressed as "average percent 
correct** scores; that is, the average number of questions answered correctly hy\ 
sixth-grade students as a group. The average i)er^ent^correct score can also b6 
thought of as the percent .of ^students- answering a "typical" test question correctly. 
Thus,- an increasie'^ of 1 percent from .1975-t76 to 1976-77 means ,that 1 percent more 
'students were able to answer a typical test question correctly in 1976-77 than 
were able to do so in 1975-76*. _ . * ^ 

■ ; " ■ ' . ■ ■ 

♦ ' As showji jtn Table 8, th^ overall average'^erc^nt 'correct scor^ incr^eased .3 percent^ 
correct from 1975-76 to 1976-77. An analysis *of this .3 percent correct increase 
on a skill area-by-sklll area basis indicated* a gain in all^ skill areas except * 
fractions and geometry. The greatest gains were made in the areas of decimals 
(1.5 percent correct) and measureineht and grap*hs-Q^.4 percent). The. greatest 
ciecliee (.6\percent correct) was in the area'pf fractions. 
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In the, followihg paragraj^hs student performapce is 'Aescribed for a variety of- 
questions in each *^skiir area. ^The performance of studpnts is indicated in ^terms" 
'of the percent .correct sto're. -For each example question presen^ted, tlie perQenti|l 
of the students wha cho^ each response is indicated in parentheses J^ef ore each I 
answer, and the answer sp^jQe"" liter eepond^ng to the correct response has been 1 
shaded. A judgment as 'to whether the* performance on a question was poor,>satis- 
factory, or ^ood^^mu^t jie based upon th^^d^f f iculty of the task involved ..-^or'^' 
example, k score, of SO^percent correct on one question may not -'te^ su^eriorS^ 
a score of 50 percent- cprrect 'on another question unless 'the difficulty of rtie 
' tasks ;Lnvolved in the two questions is judged equal. Although the following 
^paragraphs contain, the conclusions of the Mathonatics Assessment Advisory 
Cdmmittee, the reader should be able to draw his or her owa conclusions -iregar ding 
the^students.' pei^ormance. . ^ 



Ari'thmetic 



The arithmetic portlx^n of the. Survey contained a total of 96 questions in four 
skill areas: number concepts ,^hole numbers, fl?&ctions, and decimals. As shown 
in Table 8, the averag'e percerit correct score on the total arithmetic portion was 
61.x), which was the same pcare as in '1975-76.' The performance of students in each 
of the arithmeti(if skill areas is discussed below*. ' * ^ , , 

Nuij!bcw Concepts The. average percent ^correct scof e^ on the 28 number concept 
questions was^65.5, which wafs sli*ghtly (.1 percent correct) higher than in 1975-76 
The number concept ^questions caji h% further classified into the areas of . numeratJ.o 
number theory, and number properties. AftW rev#wing the performance of Students 
on number concept questions,^ the Mathematics Assessment Advisory Committee judged 
,^that students generally performed satisfactorily on such quest^ions. > - 

"Owe 13 numeration questions involaiBd recall o'f naines of whoje numbers,^ fractions, 
or decimals; itie»tlf icatibn of place value; and such skills as recognizing ^points 
On a number line. 'On-a t^ical numeration guestion, *75:6 perc^ of the sixth- 
grade students selected .fhe correct answer, -This was an increase of ^6*percent 
over 1975-75. Exangde A^is a -typical numeration question. ▼ /• 



Example A 



VVhaj digit is in the tens' place in'4,263? 

( 9) O 2 * 

•( 6) 0'3 

'( 5) 0 4 • • , •- . 

(76) • 6- ■ _ «S 

( 4) O None of these 
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Sweflty-six flercent of the sixth-grad^ students marked the question in, Example A 
correctly. It ir interesting to note that.ofy those who missed the question, -9 
percent appMed the place-value x\x%e from the ''teft to the tight rather than f rom v 
the ri«ht to the left. • - V ' * . • . ' , • . #f 

The nine questionsUp hmnber theory required the- students to recognize odd, even, 
prime, and composite numb«;^ . Several of thefse questions required them to^'- 
compute the lowest common multiple or. the greatest comiiion divisor. On a typical 
nxmiber theo'ry question, 56.1 percent of the students selected the correct response. 
The performance of students on' these questions remained \^nchanged fxOm 1975-76 to 
1976-77. An example perfortonce on a nimiber theory question (Examgae B) follows: 



Ekkmpie B 



What is the least common mul^ple of 15 and- 
18> 



(72) O 3 

( 6>o 15 ; 

( 18 
(18) • 90 





Nearly 3 percent fewer students respondied correctly on the abgve •qu^tiron*rLh%< 
^.976-77 than in 1975-76. It i A also informative to note that 72 percent idexi-\ - 
tified the incorrect choice that corresponded to the "greatest common , divisor" 
Instead of the "laast common multiple," 'Students generally confuse thes^ concepts. 

The six number, property questibns> asses'sed^the students* understanding ' of either 
the commutative, associative^ or distributive properties.' On a t3^ical liumVer ' 
property 'question,' 57.8 percent of thf students responded correctly* This percent 
represented a slight decrease (.8 percent)'*in performance aff compared to that in 
•1975-76. ^The following, question (Example C) is^a t3^cal nimiber proper tyy quest ion. 



Examt)le C 



' 5eJect the correct name for the missing nufn- 
ber. • * • 

6 X 15 = 0 X 6- 
( 3) O" -9 . ■ ^ 

(59) • 15 . ' .• > 

(25)0 90 ' * . • 

(■•6) p 540 

( 7) O None of these 

: — £ ^-i _ 




Mathematics Resultp^, Srade Six 



81 



• flu ' ■ ^ 

For the above question the 25^percent response' for the distractor that' corresponded . 
tha product of 6 and 15 indicated that a large numb er.»df* students perlidjt did not 
understand ti^e concept ^fcf^V'commutative propei^ty, " . ' \J * ' y 

VthoXe Numbers ♦ The 'average percent cornet score on the 28 questions on whole 
numbers -was 67^5, which was an' increase ';of .SCl^ercent correct over 1975-76; The 
Mathematics Assessment Advisory Committee members examined .separately the scores'on 
whole number questions that were \?ur^ly com'putatidnal and for those that involved 
.word .problems. In. the, opinion^ of the committee, Students did "quite well" in com- 
putational tasks involving- addition',, subtraction, and multiplication, ^ 

The^LS computation questions on whole numbers required students to perform addition, 
subtraction, multiplication; 'or^ division of vhble numbers; and the 12 application 
questions required ^h^ tti apply arithmetic op^ratio.ns in solving word p-r'oblems, 
A typical computation questmen was myJted correctly by 77,9 percent V.- the students. 
Which reflected a slight increase (.S^percent) over the percent In ;1975-76, A 
typical application question, vas .marked cqrrectly by 53-,6 percent of the students,' 
an increase of .7 percent oter-the 1975-^ percent', "Two .examples ^n 'comjputation 
(E^:amples .D and E). and one 'in applica^on (fixamiJ.e F) follow. 



Example 



Licaftion 



■ -J - ■ •. • 






(•^^ ' 268+745 = 
" . ' f " • . • 






' • " ' 41) 996 






^ - (2)^ O 1.006 






(95) • 1,016 






■ . - (2) 0 1J16 . 

•» ' * f 




• 


• \ 

^i-. 
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The above question wa§ n^rTced iSbrirectly by almost ^1 sixth-grade students. 
Altheugh'the sfudent-s ' experienced difficulty with long-d/vision problems, the 
.statewide scores "on such problems <*id improve slightly in 1976-77,, ,The .following 
is an example long-division problem: ' . ' . * 



Example E 



■ 1 




As the members of tha committee anticipated, a sizalJle percent of students- (l9 
percent) marked the ^^ourth choic,eV whicli indicated a typical long division error 
Irivplving^ d'?ero in thJ^guotient. 



S2 ^ Student Achievement In (:al If ornia. Schools 

The following la an exajuple word pWf^lem: --"^^^^ 



Example F 



John hns 3B? stamps in his !^tnmp collectiorl, 
Gfpq has 224, Pete has 31 a and B6bhasJ75. 
'The number of stamps the boys have alto- 
(jfMhpr ij CLOSEST to which of the following' 
numbt^rs^ ^ 



(8) O* 900 
(19 >0 1.000 
(61) • I'lOO 
(12) O 1.200 



The above question- involves a4<iing the ,three numbers and then rounding off the. 
sum .to the faearest one hundfed. - . - . 

Fractions- , The average percent* , correct score on tn,e -20 questions on fractions 
Was 49.0 which was .6 percent correct lower tl^n the score in i975~76. The 
Mathematics Assessment Advisory Committee members xwted that the lowet score in 
this area may "be related to' the recomm:endatdon in Ulathematics Framework for 
- sgalifornia Public Schools for d^ecreased emphasis, (wA.frac^tio^is in kindergarten 
through grade s^.x, > - - , ' / ^ ^ ^ 

Thirteen of the fr|^ction questions, involved pure computation; that is^ additipn 
subtraction, multiplication,, andf division of .numbers 'in ^rac^ion ^f onu,, S^ven 
questions wer^ application -problems which requ^ted^fche student;^^ to, solve word' 
.problems ijnvolvipg .comron fractions, ratio, knd percent. A ^typical computation 
question was marked correctly by 49/8 oe>rc^nt of tiie .sixth-grade studetil^sT .an* 
a^typical va|>plication question was jn^rked '€y ^47.*5 percent, ^bf "both types of\ 
problems,,; scores declined .6 p£ircerit< *.Twa examples 'in • computation ([ExampJ.es -^G 
ahd* H^U^n<i on^ in application (Example I) afjp sKown below. ^ ' ' * 



Example G 



• 2 ^4 

:. • (3) o r 
■ "- as) ' 

\ \ (5) 0| 
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'Nearly^ two-thirds of California 6ixth-grade students wete able to apply the 
multiplication fiii^ for two commgn fractions* , ^ • ' 



• Example H 




1 • 1 - . 


• 


♦ 






(21) O-^/ . , 


1 








(45) O 1 . 










(30) • 3 


/ 




i * 




(,4.) O.Y2 







1 k 

The problem in Example H requires performing the ^relatively difficult operation 
of dividing a proper* fraction by ahother 'proper fraction* 



Example I 



Laurie has saved $5 to buy fclothes thpt cqst 
What fraction of the total has she saved?- 

(1-8)0 . • ' . 

. (ii)o^* ' ■ ' ; - . , ♦ 



(2^)p5 ' 
(49) • 3 



t 



t 



The word problem in. Example I was marked correctly by 49 percent o\the students. 
Thie data, indicate that nearly half ^f* the students did not understand^ the^ meaning ^ 
of "fractio^ of 'the to^al," . \ ' " 

Decimals > ^The a^er^fe percent correct scone on- the 20 deciinal questions wa'g 57,8,' 
^ which was sigirfct icantly h'igher (1,5 percen? (jorrecif) than the score, in 1975-76. 

The Mathematics Assessment Advisory Conmittee .believfed 'trabvthe gains. on decimal 

quesjtions may be the result of the new Aphasia on metfics m aathenta'^i^ progarams 
• throughout t*e stateT Mathematics Framework for fcali^rnla /Public Schools' contains 

a ^ecommendatio'n that iucreased instructipaal emphasis be pLiced on the to^tal ^ / 
^concept of decimal numbers kindergarten^ through grade sit. 

' Of the 20 decimal questions, 12 required the students to perfprm addition, sub- 
tjraction, multiplication^ and division *of^"ntmbers in decimal form* ,The rema^^nl^g \ 
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eight questions were application problems that required the students to solve 
word problems involving^ decimal fraction's, 



V 



A» typical computation question was marked correctly by 58.9 percent of the students; 
this -was an increase of 2. 3, percent over the 1975--76 score. A. typical application 
question was marked correctly 'by*56- 2 percetlt of the students, which represented^ , 
a slight (.4 percent) increase over the 1975-76 score. Two ex^ples in decimal 
computation (Exap^-les X and K) afid one word pi^blem^ (Example L), are given below. 



Example J ' 

V . i 



38.06 ( 
+ 5.68 ' > 

(2) O 33.64 
(4) O 43.64 . 



m 43.74 (91) 
Q' 44.74 03) 



The above question is", a simple problem involving an equals number of digits after 



the decimal. 



^ ^ Example K 

r 



.006 X .08 = . 

.(46) • .00048-, ^ - 

'(•26) 0.0048 ' 

(11) O\048 

(7) O .48 ' 

(10) .,,0 None of these 



4 * 



The above problem^oA multiplicatipn of tyo decimal number'^^nvolves a relatively^ 
diffftult operation. A significantly greater^ percent (4 percent) of the students, 
marked the* correct answer in 1976-77 than in 1975-^76. 



Example L. 



- A; the Christmas season, the Boy Scouts cut 
83 phfistmas trees and sold them for $3.50 

t ^each. .How tnlich did the Scoutt/receive for 
the trees? ' • ' ^ * 



C5) O$260.56 
(8)\0$289.50 , 
(frl)*!$290.50 

(2^)ONone of these- 
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TKe above proH^j:;equires the'^student to understai;^ the- reading material, 
for:mulate a mathematical ^ressidn, ^and then multiply^the whole and deciifel' 
numbers. - Sixty -one percent of ^he sixth-grade pupils irfarked the correct' a^Jwer^ 




Geometty ' * . 

^Thfi/ ^rvey included, 20 .questions on geomietry; eightlSWE|^he questions required the 
.students to ident;lfy* basic geometric sets and ;||lguresfmt the other .12 questions 
required them to demonstrate an understanding of geometric cofrcepts. As shown in 
Table 8, the oye^rall average percent, correct' scoire'in geometry was; 58.5, which 
was slightly (.3 percent correct) lower'.than the score in 1975-76. A breakdown 
of ' the, overall percenj torrect score revealed that a tjrpical recall question was 
marked correctly by*68.4 percent of the students and that a typical understanding- 
of^cohcept question was marked correctly by 51.9 percejit of the students. An 
item-by-item examination the results by the members of the Mathematics Assessment 
Advisory Committee revealed that sixth-grade students performed ^'exceptionally 
well" on^problems involving similar triaagles, identification of radii, and cunits 
used to measure a/ angle. The committee ^Iso noted that, scqres were ''high^' on 
Nj^oblems ii\ recognition of geoift.etric shapes. The committee recommended additional 
fftetructidnal emphasis in the following skills or concepts in grades one through 



Identificatioir of quadrilaterals, *<iiaiaiBter of a circle, and 
corner of a aquarg a,s a righ^ahgle » * , 




«• The^lm of the 'interior Angles of a triangle is idjQ 

• .TwQ noiicoincident/straf'ght li^s intersect \n a point 

One example o^ recall (fixainpO^e M) ^nd one* on concepts (ExAple N) -are provided 
,belDw. /'^ ■ . ' ' m r 



^fexamplia M* 



Which picturjB^hows par^ll^ lir^te^ {' 



(77) 



V 




r 



.(4) 



(7) 



O 



O 



O None of these ♦ 
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(46) 
(10) 
(35) - 
(6) 
(3) 



If two different lines intersect, their intersec- 
tion is: ' " ■ 
/ 

^ O ? line segment 
O a line 
• a point ^ 
O a triangle 
O a square 



The problem in Example N involveat a relatively difficult-. geometric concept.'' 
^Bec^use of the. small percent of correct responses; the committee recommended 
increased instructional emphasis on the skills iciv^^ed in such problems. 



Measurement and Graphs . » ' • 

^The Survey inclu4ed.32 questions in the area of meAsurement and graphs. Fourteen 

festions wei^e recall or computatiori questions thar required students to demon- 
rate their ability to estimate; convert on^ unit to another unit;^ and perform 
jLthmetic op.erations related to length, mass, volume, and time.'! The remaining . 
lo questions were word problems dealing with the measurement of length, area, mass, 
volume,' and time. Some of the questions required the students to interpret graphs. 

. I ' ^ ' < 

As shown in Table 8, . the 'av^rage\per cent correct scot^e in measurement and 
graphs was 53.5, a marked increase of 1.4 percent correct over the score in 1975-76. 
, A typical recall question was' answered correctly by 47.2 percen^of the students, ' 
which was' 2. 4 percent^ Jiigher than in 1975-76. A typical word problem que^^ion 
was answered correctly by 58.4 percent of the students, which represented a slight 
(.6 percent)- increase over the percent in 1975-76. 

The Mathinatics Assessment 'Advisory Committee noted that 1976-77 was the second ^ 
consecutive year in whfch the students made gains in the area of measurement; » 
over a two-year period, the sixth-grade students registered a gain of 5 percent 
CQsrrect in the knowledge of measurement facts. The committee believed that there 
is an increasing awareness of metric notation and terminology in kindergarten 
through grade six as recommended in Mathematics F^mewqj^k for California _Public 
Schbols . An item-by--item analysis of the recults W vthe committee indicated that 
the sixth-grAde, students • could satisfactorily read crtzferent kinds of measurement 
scale's. The committee also de^rmined that the students were weak in worki^ With 
denominatejnumbers. Furthermore, two areas* in which the committee note'd eome, 
but insufficient, impr^^vement were: 

• Conversion of area measures from one unit to another unit within • . 

the same system ^ \ ^ * " ' , , * 

. • Computation of ^ areas and perimeters of simple geometric figures 
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The committee recoiranended that incr^ged instructional emphas is j)5c» placed on 

J these two skill ai^eas. 

^ • '"^ • " ' ^ ' ^ . > \ 

^Examples o', P; Q, and R are typical questions on measurement and graphs • , . 



Example 0 



J 



How long is the^.fiail? 





• / 








i 1 ' 

1 2 : 


1 ' 
1 * i 


1 


1 

5 


1 1 
6 






- *' cm 









(10) 0 2cm" 
85) •2.5 cm 

O 4.5 cm 
(^) O 5 cm 



The abov*(? question required the student^s to re^ the ruler to the nearest one-half ^ 
qentlmetre. Ten percent of the students were not a,ble to infer the middle point ' 
between the second and third centimetre marks andjl percent ignored the centimetre 



marks on the ruler. 



Example P 



4,hour&30 minutes 



(48) O 1 2 hours^O 'minutes. 

(4 2) •,13 KourVSO minutes 

(6) O 7 hours 30 niinutes 

(4) O 7 hours 33 minutes 



1 



to muitir 



The question In Example P called for:students to multiply a denominate number. 
The committee noted that 4 pfercent :f Iswer students insWer^d this que^stion correctly 
In 1976-77 than in 1975-76. " - : Z ,- * - ' ' . . . 
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HOW MANY FEET BEFORE YOU CAN STOP? 



30 



SO 



70 



to 



I IJ N 11 I I I I 

1^ I RffMtiOA'timt Oittanct 
Braking 0»iunct 




20<L 

Stoppinf Dittsnct m Ft«t 



( 



Example Q 



What is the top safe speed indicated for stop- , 
ping within a maximum distance of 1^0 
feet? 

(18 XD 30 miles per hour O 50 tnil.es per hour(23) 
(53)^^40 miles per hour O120 miles per-hour(6> 



'm 



Exam'ple R 



ERLC 




If Mr. Smith is traveling at 60 miles pei»hour 
^ when he sees a car backing from a driveway 
, into h'is lane, in hpw many feet can Mr. Smi.th 

stbp his car? ■ 



(28) 0 3^^^ 
(20) 0 65,. 



0 230 
• 260^ 



(21) 
(31) 




SI 
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/ Ab sh6wn by Examples Q and R, the performance of the sixth-grade students on' 
application of measurement aijd. reading of graph" questions varied with ^the -dif- 
»^f$^ulty oJf thfe questions* ^ 



' Probability and^^yfii^ tidies . 



The sixth-grade Sui 



ncluded 12 question^ on probability and statdsti-cs. Six 
.ated' to -simple statistical computation or were based 



1' ■'" 



of the questions wer _ ^ __ ^ ^. 

on an, intuitive approach tq probabilitfy. The other six questions required the. 
students to use concepts in probability and statistics to solve word problems. , 

As shown In Tablets, the overall average percent correct score in probability and V 
statistics was 40.9, which was. slightly U5 percent correct) higher than the acore 
in 1S75-76. *A typical* computation questi(jn was- marked*'correctly 'by 42.3''percent 
of the students,, and- a typi\:al application-type question was marked correctly by 
39.6 percent of the students. 

The Mathematics Assessment Advisory Committee noted that students were still ^eak 
in the area of probability ^nd statistical terminology.^ The committee members ' 
remaifked^afe they did in 1975-76, that since probability and statistics .concepts 
and^ terj^^^e used so frequently, in everyday life (e.g., '^chances of rain," ''batting 
averages 7" fed -Wdian salary"), students should'-'be abld lo understand, them. In 
parti^iular, th^ ^committee recommenced the following: * . 

y Bco>ability and statistical tppnindlogy should be introduced and 
. ^ emphasized in the curriculum before th^^slxth-grade lev^. % 

r '' In the s'^lefetibii^ and evaluation of ffiw instructional materials' 
mathematics, attention should be given to the presence of 
. ^ proT)aMlity ^and statistical terms, and concepts. 

Two examples,. (Examples S and T) of problems in probability' and statistics 
ai?p -presented" below:. *• . * tii 



Example' S 



■J^ind the^averagfe of the folJowing set of 
imbers: ' 



25, 45, 20, 30 



(13)-; 25 

(40) ^ 30 ( 

^ (22-) O 35 V 

(l3) O 40" 

(12) O ,45 , 
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The qiiesfion in Example -S and a similar question in which 4he wox;d "average" j^*^ 
replaced by the word "mean" were Included in the test to find out how much 
statistical terminology atjidents learn by* the end of' thfe sixth grad€i. Foi^t^y per-*^ 
cent of the studmts marked the correct answer for the question in Example S, but 
only 20 percent ^pRced the correct answer for the question in whi&h the woird-'Wean" 
was replaced by "average!" Thus, 20 j;;te^rcent of the students may have answered 
the first question correctly not because they understb^ "average" as a stAti*stieal 
(foncept, .but because of their day-to-day familiarity with t];ie wprck ^'average. "^ It * ( 
is noteworthy that 6S*percent of the sixth^g^rade students knew the meaning of the ^ 
word Vaverage" (see page 31) indicating, perhaps, that 25 percent of the students 
did not know how tp compute the .average of four numbers. ^ 



\ 



Example T 



Jhere''are.4 appll^.in, ajjasket. One of the 
,>^appJes is green si.n3 the-ZeSt are red. If one of 
J, the' apples falls out, the probability that it rs a 
. ^reen apple is: ' f > , 



an o 1 

(23),0 I 
(14) O 3 



/ 



' — J^ie question in Example t i& tjased upon an intuitive approach to probability. 
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Mathematics Results for Grade Twelve 
Scope of the Grade Twelve Survey 

The Survey of Basic Skills: Grade 12 was^ developed to assess, the degree to which 
students^ have acquired "ba^c" matheniatics skills by the end of the twelfth grade. 
A statewide committee compiled objectives and reviewed questions for inclusion in 
the test. The 198 ^uestion§yon the Survey were designed to assess students^*' skills 
in the areas of arithmetic, algebra, geometry, measurement and graphs, and pro- 
bability and statistics. Figure 6 illustrates t?he emphasis giv^ t?o each skill 
area In the t^otal* test. In the figure the skill area of arithmetic is subdivided 
into the areas of number concepts, whole numbers, fractions, an^ decimals. A 
complete description of the skills assessed in the Survey is given in Test Content 
^Specifications for the Survey of Basic SkillS: Mathematics. .Grades, Six and Twelve . 
Additional descriptions of the major skills assessed in the Survey and example 
test questions are included in Appendix G of this 'report. 




V 



Fig. 6 . Skill area empliases in the Survey of Basic Skills: Grade 12 
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Table 9 shows the achievement results of- California twelfth-grade students 
on the total test and in the skill areas for 1975-76 and 1976-77. The table also 
shows the increases or' decreases in •scores from 1975-76 to, 1976-^7. A detailed 
breakdown of the skill-area results is given^ in , Appendix G. * ^ 

In Table .9 the scores and score changes are expressed as the "average peircent 
correct'^**^core> which is the average number of quesitons answered^ correctly by 
Califofnia\ students as a grolip. ■ The percent correct score can also be thought 
of as the percent of students who answered a "typical" test question correctly. 
Therefore, an increase of 1 percent frpm 1975-76 to 1976-77 means that in 1976-77 
1 percent more students were able to answer a typical test question correctly ^ 
than were able to do so in 1975-76, ^ , , • 



Table 9 ' 

Mathematics Performance of California Twelfth-Grade Students 
on the Survey of Basic Skills; Grade 12 



Skill atea 



Number of 
questions 



Average 'percent 
correct ' 



1975-76 



1976-77 



Gain(+) or loss(-) 
in score 

-4-2 0 +2 44 



TOTAL MATH 

Arithmetic 

Number concepts 
Wide' numbers 
Fractions 
Decimals 

Aigel)ra. ^ 

Geometry 

Measurement 

Pro>)^bility 
and Sftatistics 



(198) 

(98) 

28 
22 
26 
22 

' 32 

24 

30 

14 



67.0 

72.9 

74.3 
80.1 
66.0 

r 

6^.9 
62.7 
60.5 

57.2 



66.3 

72.1 

73.5 
80.1 
64.5 
71.2 

,62.1 

62.1 

59. 5 

56.9 



- .7 

- .8 

I .8 
0.0 
-1.5 

- .6 

- .8 

- .6 
-1.0 

- .3 



' ) 

As. shown in Table'.9, the overall average .percent correct score in 1976-77 was 
66^3, which was .7 percent correct l^wer than in 1975-76. A comparison of the 
skill area scores across years showed that students performed 'at the same level 
in whole numbers, but' that their performance in all other areas declined. Th^ 
5reaJ:£ai:-4ieeli3ie- (1. 5 percent correct) was in the area of fractions. 
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Skill Area Res 




fdr Grade Six ' 



In the following ^ragraphs student performance is described for a variety of 
questions In each s^ill area. The performance of .students Is indicated by the 

For each' ex^ple question presented, the percent of the* 
response is indicated In parenthes'es before each answer, 
responding to the correct response has been shaded'. A 
performance on a question was poor, satisfactory, or • 
good t^ust be based upon the difficulty of th'e task Involved. For example, a 
score of 80 percent correct pn one question may not be superior to the score of-* 
50 percent correct* 6n another question unless the dlfflpulty of the tasks involved ^ 
*ln the two questions is judged equaJL. Althe^igh the following paragraphs conta^in 
the conclusions of Mathematics Assessment Advisory Committee, the reader should . 
be able to draw his or her own conclusions regarding the students' performance. 



.^percent correct scor 
students who chose ea 
and the answer space c 

, judgment as to whether 



Arithmetic \ ' ' * 

^The arlthmetlc\^ortlon of the test consisted ^of 98 question^ in four skill >are^s: 
number concepts, \ whole numbers, fractions, and decimals. As shown in Table 9, 
in 1976-77 the average^ percent correct score on the total arithmetic portion of 

' the test was 72. 1,\ which wa^ .8 percent correct lower than that in 1975776. The 
-pe^rforpance of the ^students in each of the arithmetic skill areas is discussed 
below, . , . . , 

Number Concepts . The average percent score on the 28 number concept questions 
was ^^3.5, whlcK was .9 percent correct lower than the 1975-76 score. The number 
concept questions inciu(fed problems on numeration, number theory, and' number' 
♦properties. In 1976-77 th^ greatest decline (1,1 percent correct) was on -qoestions 
-iwolv^^ng^ number properties; the least; d^tllne (.3 percent correct) was on questions 
tf^a'rtaining to number theory. * 



The 14 numeration questlbns Involved the recall of names of whole nuinber-s, fractions, 
and decimals ;»ldentTTlcatJ,on,0f place value; and such skills as recognizing points 
on a number line.^ In 1976-77 a typical numerat4.on question was answered correctly 
by 70.1 percent of the students. An* example numeration question (Example is 
given below. . -. ' 



Example A 



\ 



Which is' the numeral {or seven thousand six 
hundreid thirty-four? 



(96)^7,634 

CD O 70,634 



' O 7,643 (2) 
-0700,634 (1) 



The-quiestion in Example A was marked correctl/ by almost- all the students. It is 
interesting to note that this question also appeared on the sixth-grade test an5 
"tthat 'gi'percent of the sixth-grade students marked the Question correctly. 
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-The eight number theory questions required students to reqpgnize odd, even, 
prime, and composite numbers. Several questions required computation of the ICwest 
common multiple or the greatest common factor of several numbers. A typical 
number theory^ question was answered correctly Hy 75.9 percent of the student^-; 
The question the following example (Example B) also appeared on the sixth— 
grade mathematics test. ' . ' - 



Example B 



f n IS ao odd nurnhnr. th'on n ^ 1 fs: 




(9) o always'o(ir 

(76) ^ always evnn 

(14) o even or odd dopondinq upon what n is 

(1) O None of thf^so 



l^he question in Example B was marked correctly by 76 percent of the twelfth-grade 
students. In comparison, only 36 percent of the sixth-grade students answered 
this question correctly. 

The six number properties questlo^ on, the twelfth-grade test required students' 
to recognize commutative, associative, and distributive properties.^ A typical 
number properties ques'tion ^was marked correctly by 78.5 percent of the students. 
A* number properties question is shown in Example .C. 



Example C 



Ax 8 = (4 X 8) + (5x 8) 
What numt)er goes in tlie A above? 



02 
•(7) 



(6) 



• 9 

(83) 



O20 



I 



Although the question inxExample C could be ahswered by se^iral different methods, 
for example, by solving as an algebraic equation, ,it was as^ume4 that; stud*ents 
would use the distributive property; that is, they would add "4"*and "^'5" <<f g^t 
the answer "9." , i , — '4 " i 



Whole Numbers . Of the .98 questions on arithmetic, 22 questions c'oiild be eiaU^ified 
as whole numbfer questions. Fourteen of the whole number questions were /plir el com- 
putation problems that required the students to perform afld4tion, subtr£['ct:ioi!i,'* 
multiplication, or division of the Whole numbers. ' The remaining eight- questions 
were word problems that required .the students to apply arithmetic operatiojis.l 
As shown in Table 9, in 1976-77 the overall average percent correct score\6*n yhole 
number problems was 80.1, the same score as in 1975-76. .Also, a typicaJL compu- 
tation question 'was marked correctly by 87.7 percent of the students, and a typical 
word problem, was marked correctly by 78.5 percent of the students. The" computatior 
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a'nd word\i)roblem scores remained essentially the same as in 1975-76, Two exaipplesp- 
# one in computation, (Example D) and one word problem (Exanjple E), follow. ^ 



Example D 


ri— 


\ 




(DO 2 remaind^e 
(2) O 6 remainder 1 


m 6 rernairuicr 2 (92) 
O 6 remainder 4 (5) 



ExampA E 



If Mf'If^plKMH ' all fuMH Mf'do to Porso costs no 
f^iDfs ffu rho first 3 mimitps and 1,0 cents for 
onch a<MiiionMl ininuto. tlion a 6-minute telp 
phof^p call from Me(ie to. Perse costs how many 
c^nts^ ' 

(18) ' H.} V JS) » ( ^ X JO) * 

(3) ' X X 10 
(5) ^ i^ X .^MN 10 ' . 

(74) • 35 ^'{'1 X ']()) 



The first problem in Example, D—a relatively simple long division question—was 
marked 'correctly by 92 peirc'Sht of the twelfth-grade students, /This question also 
appeared on the sixth-grade test; 78 percelnt of the sixth-gradel students marked 
the question correctly. The question in Example E requiii-ed jfrhe students to com- 
prehend a word problem ai\d formulate a mathematical expression to use in solving 
t:he problem. 

/ 

c . 

Fractions . Of the 98 questions on arithmetic, 26 dealt with fractions. As with 
whole numbers, 14 of the questions on fractions involved p.ure computation and 
12 were word problems. The word problem qitestions /required students to solve 
questions involving fractions, ratios, and' percent/. As shown in Table 9, in. 
1976-77 the overall average percent^ correct score, in fractions Was 64.5, which 
was 1.5 percent correct lower than' the score in* 1975-76. The decline (2,1 percent 
correct) on the computation questions was greater than the^decline (,9 percent 
correct) on the word problems. In 1976-77 a typical computation question was ^ [ 
marked correctly ky 68.3 percent of the students, and a typical word problem was ' 
marked by 60.0 peicent. Two examples — one in computation (Example, F) and one 
word problem (Example G) are given below. 



Example F. 


4x^ - 








V 


1 I 


• 31 


O 4| 


O 5 

0 


\ 


(8) 


(67) 


(14) 


. (U) 
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Example G \' 



A bar ol candy was divided 'among thi-ee people 
so that Mildred had 5 of the bar and Abby had 
^ Wh^ fraction of the bar was left for George? 



0^ 



(78) 



(3) 



(12) 



.(7) 



Both of the.^above questicJns also appeared on the sixth-grade Survey *. ^ For the 
problem in Example F, the students were required to multiply a whole number and 
a common fraction. Sixty-seven percent of the twelfth-grade students marked the 
question correctly. ' By comparison, ,46 percent of ^the sixth-grade students marked 
the question correctly. It is inf orma^tive 'to note that, 5 percent fewer si-xfh- 
' graders and ..3 percent fewer twelfth graders^marke4 the question correctly in 
1976-77 than marked it correctly in 1975-76.' ^ 

The question in Example G was , designed to assess skills in the area of fractions 
in the context of everyday situations. Seventy-eight percent of the twelfth- 
graders and 52 percent of the sixth-graders marked, the question corrjBctly. In 
comparispn to tl^^ results in 1975-76, 1 percent f ewet sixth graders and' 2 percent 
fewer twelfth graders marked the question correctly. , 

Decimals . The arithmetic psrt of the test contained 22 questions* on decimals. 
Fourteen, computational questions required students to perform addition, sub- 
traction, multiplication,- and" division of ^numbers in decimal form. The eight 
word problem (Questions required the students to solve word problems Involving 
decijQals. . As shown in Table, 9, in 1976-77 the percent ''correct scojre on decimal 
problems' w^s 71.2, whicK was .'6 percent correct lower than the score in 19^5-76. 
The score was much low^r on application questions (1.2 percent correct lower) 
•than it was on comjlBation questions (.3 percent correct ^lower) . A t3rpical 
computation questicm was^ marked cbrrectly by 84.0 percent of the students, and a 
typical application"* question was marked correctly by 66.8 percent of the students. 
Tt«^examples (Examples H and I) ^follow. 





Example H 


: 5 X .5 = 
















O 1.0 


2 5 










.., (84) 


(3). • ■ 


•^(12) 


. (1) * 
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Example I 



. Miss. ;JdneS' has $158.62. She makes pjurchasos 
.of. $5:25, -$49,88, and $10.35 and receives a 
check for $51. 64. How niuch nnoney does shr 
now have? * - * ^ 

(6)^ ;$172 46 (lo) 0$41 50 
(82) •f$144.78 (2) 0$13.84^ ' 




Both of the above questions^also appeared on the sixth-grade Survey . The ( 
computational question (Example H) which Involves multiplication of two decimal 
fractions, was marked correctly by 84 percent of the twelfth-grade students/ * 
which was an Increase* of 1 percent over the score In 1975-76. By comparison, 
76 percent of the sixth-grade students marked the correct answer, an Increase 
of 2 percent over the percent lna975-76. The question In Example I, which 
Involves working with decimal numbers to solve a word problem, was marked^ correctly 
by 82 percent of the twelfth-grade students. Vlf ty-one- percetft of the sixth- 
grade- students marked the same question correctly. On this question the scores 
of both the sixth- and twelfth-grade students showed a slight cjecline from the 
1975-76 scores. \. 



Algebra * »« * " ' ' / 

Of the 32 questions on algebra. 14 ques'tlons required the students to solve linear 
algebraic equations and recall basic concepts of coordinate geometry; Eighteen 
^hfr s ■r'"'^'' the students -to solve word p robins and 4 interpret tfbLs 
charts and graphs. As ^shoWn In Table 9, the overall averajl percent co.rect 
score In alglbra was 62.1. which was. slightly lower'.^.S percent correct lower) 
than the score In 1975-76. A typical equation-solving question was marked cor- 
rectly by 6^.9 percent. of the students; apd a typical question related to tables • 
IniT: r f.^^ '''^''^^^ correctly by 59.2 percent of the twelfth-grade studenti 

examination of the results by the' committee members revealed thW 
^ ^^^^ ^"'^ experienced difficulty In drawing conclusions 

from graphs that contained multiple factors. The qommlttee' believed that Increased 
Instructional emphasis upon these kinds of' problems will equip graduating twelfth- 
graders with Ufe-coplng skills . ^ The f ollowln_^three quftsJloL' (Example! K and 
.L) illustrate the types of skills assessed In algeb-ra. ^ 



2 qi^sti 



Example 



^ " V ^^^^^ ^^^P^ ^ 
* ^ '* 

.(2) 05 (85)*6 (4)09 (2)024 
(7) O Nonp of'these 
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Example K 



1 1 ' 






V V 








(29) 


' 1 ■ - 


(7) c,^. 


(18) 









Example L 



Refer to the graph and answer the related questions. 



30? 
20'' 
10° 

-10° 

^ -20° 

1 

30 



TEMPERATURE READINGS ON A 
WINTER DAY IN MIDDLETOWM 
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-3 
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niflHt 



At wluit hour did the lowest temperature 
readinq occur^ 

(1)C:>1 am. (60)*11 p.m. 
(4)04am (35)OMidnight 



Example J involves an equatic^n in one variable. Students generally master 
sifills in solving equations by tfie end of the eighth grade. Example K is a 
relatively difficult question. Although manipulation of an algebraic expression 
in two variables is introduced by the end of the eighth grade,, the skill is re- 
inforced for only those students who choose to take a course such as AlgebVa I 
in high school. Student performance on Example K should be viewed in* light of 
the fact that only 14 to 18 percetit of high school students take Algebra I. 
The graph problem (Example L) shows how stiidents typically performed on'questions 
.of tbis type. / ^ * ' 
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Measurement: * • ' . ' * 

Of the 30 questions- on^easurement , 12 can be categorized as recall or computation 
questions that assessed the studerits* ability to estimate and convert quantities 
from one unit to another unit* A 'few questio'ns in this category required students 
to perform operations involving length, mass, volume, and tiafe* The overall 
average percent correct score in measurement Xfas 59.5 1 percent correct lower 
thaji in 1975-76.- A decrease 'of 1 percent correct was also noted on recall and 
word problem questions. A typical recall question in measurement was marked cor* 
r^ctly by 70.5 percent of the twelfth-grade students, and a typical word probl^ 
was marked cortectly "by 52,2 percent of the students. The committee observed that, 
in^general, student performance in denominate numbers remained at' a satisfactory 
level. The committee found that the students were weak in division of denominate 
numbers. Students* understanding of the appropriate uses of common units of measure 
(both- metric and U.S. customary 'units) continued to be satisfactory* The committee 
recommended increased instructional emphasis in the area of unit pricing and in 
the use of measuring instruments to find lengths rounded to the nearest indicated 
unit. The following thre'e questions (examples M,' N, and 0) illustrate how students 
perfbrmed on measurement questions*. 



Examp le M 



Which OOP of the following units would be 
most appropriate for measuring tfie area of a 
basketball court? 



(94)*squiarr feet' 

(3) Osquar** kilometres 



O square inches 

(2) 

Oncres , (D 











Esample N 




lOdecimRtres = 1 metre 
1000 millimetres - 1 metre 




■t 


The length of a pencil is 1 decimetre. What is 
'it*; lenqth in millimetres? 




■ (4) 


' >10 -•100 O1000 
'. (14) (69) ■ (13) . 
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Example 0 



How, many square fee\ of lir^leurjVare needed 
to cover a rectangular floor 13 f^et long' and 
13, feet wide^ ► ^ . s 



»180 

(78) • 



O90 
(5) ' 



Q54 
07) ^ 



O 27 
(10) 



The questions in examples N ^nd 0 also appeared on the sixth-grade Survey . The / 
question on estimation (Example M) was marked correctly by almost all twelfth- 
grade students. The question on metric conversion (Example N) was marked correctly 
by 2 percent fewer twelfth-graders in 1976-77 thanf in 1975-76. However, 3 per- 
cent mbre sixth-graders marked the question correctly in 1976-77 than did so in 

1975- 76. Forty-one percent of the sixth-grade students marked the question in 
Example N correctly. , . / • 

To solve the problem in Exapple Cf, requires the knowledge of the formula for the 
area of a rectangle., Seventy-eight percent of the twelfth-grade students and 51 
percent the sixth-grade students marked the question correctly. The percent 
of ^ixth-grade students who answere4. this question correctly in 1976-77 dropped 
1.1 percent* The percent of twelfth-graders who marked the question correctly in 

1976- 77 was the "same as in 1975-76, - - ' ^ 



Geometry ' 



Of the 24 questions .on geometry, 12 required the students jto^'^ident if y basic 
geotnetric sets and figures, and 12 required them to apply basic geometric know- 
ledge and concepts. As shown in Table 9, the overall average**percent correct 
score in geometry was 62.1, a decline of .6 percent correct from the score ±ti 
1975-76. The score on appl'icaCion questions declined by 1.4 percent correct, 
and the score on recall questions increased .§ percent' correct. A typical recall 
que^^tion was marked correctly by 75.5 percent of the twelfth-graders, and a typical 
application question was marked correctly by 48.7 percent of the student^. The 
committee believed that student performance remained satisfactory since these 
resul'ts include the^ performance of noncollege-bound and college-bound students. 
,In the opinion of the committee, the students scored high on items requiring 
knowledge of facts and identification of geometrl^ objects and plirallelism. The 
committee also observed that students did not do as» well on problems about the 
similarity of triangles and those involving the Pythagorean theorem. The committee 
recommended that increased instructional emphasis.be given .to basic geometric 
concepts and skills at all grade levels because a weakness in. the ability to per- 
ceive and use geometric relationship's 'can affect students' problem-solving ability. 
Many practical problems start with and involve geometric figures as models of real-, 
life situations. The committee also recommended that the study of spatial geometric 
relationships-.be strongly emphasized. Examples Pj|)j and R illustrate student per- 
formance on\geometry questions. " 
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Example P 



The geometric figure above is: ' 

(97)^ an angle (2) Oa triangle 
(O; 5)0 a square (0. 5) Oa circle 



Example Q 




Triangle ABC atfove has a right angle at'B. Two 
of the other jides have lengths of 3 ynits and 4 
units as shown. How long js the hypotenuse/?? 

(6)03unit;5 (13')C.^6 units . * ' ' 
(Sy 4 units (28)0 7 units 
(45)*5 units ^ ♦ ^ 
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Example R 




In the figure above, the lines AE and CD are 
perpendicular to AC ' What is the distance 
from A to E^' 

(26) (34) (17) (.4) 
O40ft. •52 ft. O60ft. 0 65ft. 
ONone of these 
(19) • ^ ' ^ 



Example P alscV app^eared on the sixth-grade Surrey. Eljhty-seven percent af the; 
sixth-grade students marke^tbe question^coifrectly; 'in coijjparispn, almost all" 
twelfth-grade students ma^Bl the question correctly. 

>- . '■ -• "'^ • • . ^ 

Example, Q involves appiicat^n of the Pythagores^a theorem,, and Example- involves^ 
application of the relationships, of similar triangles. vF9rty-five percent of the 
twelfth-grade students marka/i the|c6rrect, answepfor Example Q and thirty-four 
percent marked the correct answer 'for Sample R. ■ " 




Probability and Statistics 



3 



The Survey included 12 questions on probability ^d statistics. " Silc of the 1 ' 
questibns required the situdents to compute the b^bability of^ simplLevwlts and 
•such statistics as the mean, mode, and ■mediatl of a set of • given .number^ . The 
eight application-type questions requir-ed khe students ' tp relate" cone epj^ in' 
•iJrobabllity or-statistics ' to solve word ajroblem/. As , 'shown in Table. 9, th^ ' 
bVerall average percent correct score'" in pro^aBility and statistics was 56.: 
which represented, a slighf- decline (.3 Eercent' .qprrect)" £romjthe results in 
1975-76v The decniie was uniformly reflected ■ in compixtation questlpns' aruS appli-* 
cation-type problem^. Tiypical computation question was markpd correctly by ' 
57.6 percent ^£ the students, and a typical applicatio,h\quest?on..was ^rked cor- 
rectly by'56.3 percent of the students. ' . ' ' ' ' ''^'^ '' ■ 



In th^ opinion of #he cpnimittee, the students appeared to b^jj^iliar' with- th'e 
intuitive . apptoa(ifc to probability. Also, there was-an improvSent -of -2. peijcent 
In 1976-77 in such skills as finding the'^median" of .a given set , of ' numbers ; ' 



HbWever, tl\e committee believed that the percent of students who cbuld firid^the 
median and other simpie statistical measures was still less" thak satisfactory, ^ 
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The coimntttee observed \that the terms and conpepts in probability and statistics 
are used^onimonly^ sometimes even daily, 'and that -an understanding of- such terms 
and concepts is essential in toda/Is wprldr ^, ' 

Examples S and T illustrate student performance in Jirobab^ity and statistic^s. 



Exampife'*S 





1\ 

2*1 




3/ 



The face of this spinner is divided into 6 equal 
regions. 'What is the probability that the 
pointer will stop on Region 5 if yOu*5pin it one 
time^ 



(5)0 0 (71) 
(11)0 \ (5)^ >1 



Example T 



f ip'l tho rnodian of the following set of num* 
bers 68.92,84,72,84, 75,;78 - " ^ 

O 84 O SO O 79 • 78 O 75 

(23) (19) (32) (10) (1^) 



Example S involves determining 'the probability of the occurrence of *an event 
Thia questic|n also appeared on tl]e slxth-gra^^e test. Fifty-two j)ercent of the 
' sii^ui-grade students marked tjip answer correctly as compared to 71 percent in 
grade twelve* Example T involves Vrdering numbers and findings the middle dumber 
10 perceiit of the twelfth-grade students^mSrked the question correctly. 
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VII. Analyses of Athieve/nent by Subgroups of Pgpils, 

Schools and Districts 

Introduction'* 

In this section of the report the statewide achievement findings^ are analyzed 
according to subgroups of pupils, schools and districts. In the pupil' level 
analysis, scares are averaged acros-s all 'schools for different groups of pupils 
divided according to sex, English language fluency, mobility level, and socio- 
economic level. In the school and district analyses, all schbols and districts 
are divided into several groups according to mean Entry Level Test score^ 
percent of pupils who speak a language other than English,"^* percent of pupils 
from homes receiving Aid to Families with Dependent Children (AFDC) , number 
of students tested, type of district organization, , location of school, and 
level of achievement for ^ the previous year. 

Pupil level analyses are available for iour factors at grades two and' three, > 
two factors at grade six, and^on^ly one at grade twelve. School level analyses * 
are presented for test results at all grade levels tested. 

'Results are presented in sequence according to grade level; information for 
grades two ^and 'three first,, then grade six and twelve. Within a *grade level, V 
, analy^es^are presented first for the pupil level on all factors, then for the 
school and district levels. ^ " ^ 

Some Important ^Cautions 

This chapter presents the relative achi"%vement l^vel and progress since last 
year for various types of 'pupils, schools,' and districts. The findings must ^ 
be re^d with extreme care to avoid drawing conclusions which appear sound on 
the surface, but can be 'shown to be misleading when additional information is 
added to the analysis. , 

The findings presented in this section are simply descriptive. It is easy 
to see, » for exajnple,- how small schools cQra^are to extremely large .schools. 
^Looking at the information presented, one might easily conclude that "largeness" 
is a handicap--sinoe students in* small-schools typically do better. The real 
cause (or more likely, causes) for the difference may not be size at all, bat 
other variables which are related to, both size and a'chievem^nt. We know, in 
this example, that large schools are more likely to be in large cities which, 
in turn, means ttiat they are much more likely to have a disproportionate number 
of students from economically and educationally disadvantaged backgrounds. * 
This makes it appear th^ai: size is related to achievement in a causal sense, \ 
when it is probably only correlated' because of its relationship with a more 
achievement- related variable--socioeconomic level. J^ot that one ever can be 
sure of the "real" causes of achievement test differences, but- the first step 
in the process is to sort out those variables which are most directly related 
to achievement from those which are indirectly or only coincidentally related. 
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The factors used in this report fall into two broad categories: (1) those 
variables bearing a direct, strong and well established (but not necessarily 
causal) relationship to achi-tevement such as achievement level of students when 
entering' school, socioeconomic level and percent of pupils on AFDC; and (2) those 
variables having either a weak relationship to achievement or a strong., but 
obviously non-causal, relationship., such as mobility rate> size of school, I 
and type of district organization. One has t9 be especially careful in noting 
the trjends according to this second group of factors not to treat them as 
l^causes when the patterns observed are more likely attributable to the powerful 
^ASQcicteconomic factor represented in the first group. In most cases, the 
reader's attention will be called to the possibility of alternative explanations. 

A second and even more, subtle type of trap awaits the reader. In interpreting 
the changes across years, one assumes consistency of all >Dackground factor 
data;^ i.e., that' all pupil and school attendance patterns are stable. This 
often is an inco^'rect assumption to make in California today. For example, 
the analysis will show** that school's in the bottom 10 percent of the state had 
Reading Test scores of 47.4 in 1975-76, and 47.6 in 1976-77. Unfortunately, it 
is not known whether the bottom 10 percent of schools in the two years are 
comparable. Were some schools closed, while* others reopened? Were the pupils 
in some of the bottom 10 percent schools sent to other schools? Without 
the answers to such questions, precise or sopetimes even approximate inter- 
pretations of the data are impossible. * c 

. The process oi determining, the direct and indirect relationships of oackground 
- variables with achievement test data is complex and time consuir^ing; more so 
than could be completed in time for printing in this report. Nevertheless, , , 
with proper alertness to the problems, it is useful to inspect "the achieve- 
ment differences and trend^ for various types of pupils and schools. This ^ 
section may raise' more ^questions than it settles. That, too, is progress. 
^ In learning how to *ask better questions, which in turn can be answered with ^ ^ 
new data or different analyses of existing data, one gets* new insights. This 
evolutionary process holds promise for determining which t3rpes of educational 
approaches are most effective for difJEerent typei^ of pupils. The prescriptions, 
for improving school programs will follow naturally from that information. 



Ill 



4' 




'A Pupil-Level Analysis *of Achi^evement' and Background factors, 

/ ^ G^rad^ Tw6' and Tliree' 

»- , , ^ 

w.. . . , ^ ' . ' - 

As partv'of the administration of the Reading Tes^ >. t^^achers provide significant 
background information about^each pupil. When used with the test -results, 
these data make.it possible to compare the test performance of groyps of pupils 
differing on background characteristics. , This ^section contains an analysis . , 
of the effect on pupil performance of four significant background factors: 
(1) the sex of the .pupil; (2) the pupil' English language fluency;' (analyzed 
sepai^ately according to second language spoken);* (3) the socioeconomic level 
of the pupil's family (the occupational status of the breadwinnfer in the pupil' 
family); ^and (4) the pupil's mobility rate (the year in which the pupil was 
first^enrolled in the school). ^ - 



Summary of Findings 

The following is a summary of the priiicipal eifects of the background factors 
described above on pupil performance gra ces tiwo and three: 

1. - Girls outscored bo}^s on the Reading Test J and the margin by which 

• the girls lead the bgys increased between grade two and grade three. 

2. TJie achievement of both boys afid gir Istlia^roved in 1976-77, *and ^ 
both m^de greater gains in grade two than they did^' in grade threes. 

3. -The percent of pupils ^who spoke only English declined slightly 
c between cl975-76 and 1976-77. The percent of pupils who spoke 

limited English plus a second language increased slightly,, 

^ ^4. The highest Reading Test scores were made, by tho^e pupils who*, 
spoke fluent English plus a second language. ^As a group they 
^ scored^ higher than thos^ who spoke only'Englisli. Those pupils ' 
who spoke limited English plus a' second language .scored substan- 
^ tially lower than those in the twojgrc^ips mentioned ^bove. Of 
the pupils in the two categories o£ (1) fluent English and other 
^ ^ language and (2) ^imited jEnglish and other language, those whose 
other language yas Spanrish scored , the lowest. 

5. The occtfpation of the breadwinner in* the pupil's family -was iiiore 
^ . closely related to Reading Test 'scores than any other fadtor 

Except the pupil's Entry Level Test score. On the a^raee , the 
' pupil« from the highest socioeconomic-level f amilies^^rchieved the 
highest tscores on the Reading Test: ; the pupils from families at 
th^ second highest socioeconomic level achieved the Second highest 
scores; an^ so forth* The .same pattern prevailed.with regard to 

• percent of pupils who &<:ored below the first quartile; the pupils 
from .families in the hi^est socioeconomic group were the least 
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represented ^in that gr 



oup-j- and the pupils from families in the 



lowest sociqeQoncnnic 'group were the most represented 

6, The achievement gap between the pupils in th^ highest and lowest 
socioeconomic g;roup.s narrowed slighfly between 1975-76 and 19?6-77, ' 

7, Pu'p'^ls wer*e more nyDfeile (had a ereater tendency to change schools) 
in 1976-77 than ;Ln:i:^75-76, 

' ' • ' " \ ' • ' ' ' ' • ' 

8, ^ The mo^ Taobile papils^,(i,e; , those who enroll^ed in the school* 

after grade one) scbreii lower than those who enrolled in kinder- 
garten or^grade. one and* stayed^there through grades two and. thtee. • 
Thus, it appears that stability of -enrollment ^is' related to higher 
Reading Test achievemeat. However, since it is ^Iso true' tl)at 
pupils -from higher socioeconomic- level families tend to be more 
stable than those from lower economic strata, the true impact of 
' mobility per Ise was probably very minor, 

m 

9, The relationship of mobility to reading achievement appe"arecl to 
be ' lessening. Between 1975-76 and 1976-77' greater gains were • 
made by the more mobile pupils. ^ ' ^ 

Method of Analysis 

The figures in this section show; the achievement of pupils in grades two 'and 
three in 1975-76 and in 1976-77-. The achievement scores are further broken 
.down to show the comparative scores of those having different backgrouad 
characteristi\:fi. For instance, in Table .10 the achievement scores of pupils in 
grades two and thiiee in both 1975-76 and 1976-77 ate JEurther broken down into 
the scores of boys\ and girls. ' 

?upil achiev'ement is expressed in two ways. The 'Wan Reading Test score" is 
the average percent! of correct test answers 'for a group.' The ''percent scoring, 
below first qiiartilje on the Reading Test " is the percent of pupils within a 
group vho SQored inVtti^ bottom 25"perceht of all pupils. Table 10, for instance 
show^ that in 1976-7y\boys in gr^de two had a 79.5 mean Reading Test score,- 
which meaas.that they \averaged 79^.5 percent correct answers on ,tKe test. 
Table 10 also shows that 28.5 percent of grade two '^boys in 1976-77 scored 

on the Reading Test , which means that 28.5 percent 
e. in the bottom onte-fourth of all the second-grade 
Both of these achievement-reporting* methods are neces- 
ons reported in this section. • 



below the 4irst. quart 
of boys in grade two 
pupils who were tested' 
sary to make the compa 



Percentage Below First QAartile . The figures showing the percent of each'gr6up 
that scored below the fi^yt quartile are included in the annual report for the 
first time this year. Thfese figures make itS possible to compare achievement 
between, grades two-and ^ tKriee, which was riot possible when only mean percent 
correct scores were repqrtc 

Any group of pupils can ^ivided into the fourths that scored highest, 
second highest, thjxd highd$t, and lowest. The first quartile is the score, 
that marks the border between the lowest and next-Xowest fourths of the pupils 
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tested, s The pupils who score b^low the first quartile on a test re'pre^sehV, t\ie 
lowest scorings one- fourth of the pupils who took the test., In an absolutely' 
equal distribution of test scores, 25 pfercent of each group would score below 
the fiifst quartile. Thus, if more' than .25 percenrt of a' particular \roup scores 
below the first quartile, *that group is represented more .heavily than average 
amoqg the''lowest-s€oring pupils. The opposite i*s true if less thai;i 25'p'tercent 
of the members of a group score below the first quartile.* * ' 

^ The' following examples show how both the mean score and the^percent of pupi'ls 
scoring below the first quartile . are used to make comparisons. The mean scores 
in the examples are from- the /'Mean Reading Test Score" column in Table 10. ' 

♦ «' 

' Example 1 ; . Since grade- two^ boys had a mean score of 65.2 in 1975-76 
and 66.1 in 1976-77,* it can.be said that thefr achievement improved 
' by .9 percent correct between tiie years. This use of percent correct, 
scores^^^^ides a -valid comparison. ' , 

^ Example 2 ; Comparisons across grade Levels are accurate only when 

the number of pupils below the first quartile is 'used. Percent correct' 
scores cannot be used to ans\ler the question, 'Did the gap between boys* 
and girls* scores lessen between grades. two and three?" They would 
provide the following answer. In 1976-77, the grade- two boys' score 
wa^s 66.1 and grade- two girls' score was 70.9 (a difference of 4..8 
percent). In grade -^three the scores* were 79.9 for boys and 83.5 for 
girls ^(a differe nee ^of 3.6). Does this mean that the gap between boys 
and girls narrowed from 4.S to 3.6 percent correct? No. Such an 
interpretation would be incorrect because pupils in both grades two 
I and three take the same test. This' causes scores of the 9lder grade- 
three pupils to be more closely grouped at the top of th'e*raiige than 
^ those of the grade-two pupils.. With scores distributed differently 
over the range of percentage^, a chaoge of a .few percent correct points 
has a different significance in grade two than in grade three. Using' 
"percent below the first quartile" provides for a better comparison. 
Thus, 28.2 percent of the grade- two boys and 28.5 percent of the grade-, 
three boys (+0.3 percent) scored below the first quartile. For girls, 
21.7 percent in grade two and 21.4 percent in grade three scored 
below the first quartile (a decrease of the same .3 percent). There- 
fore, .^since grade- three dboys make up a-'greater portion of the lowe^- 
scoring quarter than do grade-two boys (and the converse for girlsV^ 
'it^nnay be cqneluded that boys* and girls' scores are less equal in 
grade 'three -and that the^ gap between the two sexes widens somewhat 
as pupils' become-older. . 



Sex of i^upil 
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Teachers were asked to designate the sex of each pupil on the' pupil's test 
booklet as follows: 




Subgroup Analysis y Grades Two and Three 



109 



Slightly more boys than girls were tested itr 1976-77 in both grades two and 
three (see Table 10). ^ The numbers tested were more nearly equal in grade 
three, as tihey were the previous year'. The percentage of notiresponses (no 
se» indicated by teacher) increased somewhat in 1976-77; This may have been 
caused by the moving of the Response grid for this factor, which the teacher 
fills in, to a less noticeable position on the test booklet. 

Both sexes in 'both grade's .showed improvements in mean percent correct. The 
girls in grade two answered an average of 70.9 percent of the questions cor- 
rectly, an increase of .9 -percent correct over 1975-76.' The 'girls in grade 
three answered 83. 5 percent of the questions' correctly, an improvement of .3 
percent • The improvement of the boys wa^s about the same; in grade two they 
averaged 66.1 percent correct, an increase of .9 percent over the previous 
year. Those in grade three answeired 79.9 ^ercent^ of the questions correctly, 
an improvement of .4 pe'rcent. \ ' ' \ , * 

More boys than girls scored below the first quartile, and the percentage of 
boys in this group increased 'between grades two and three. Of the grade- two 
girls, 21.7 percent scored be^l^w the first quartile; in grade three the figure 
was 21.4 percent. Boys showed ^ust the opposite result, going from 28.2 per- 
cent in grade two to 28.5, ^erceni in grade three. Tl^is increased percentage of 
boys in the first quartile Indicates a widening of the gap between boys' and 
girls' achievement as they iQpved froni' grade two to grade three. 

English Language Fluency * ' ' . 

Teachers were asked to designate the language (s) that the pupil spoke as follows 



ENGLISH LANGUAGE FLUENCY 

0^^"y'>sh Only 



O f't^Jcnt Engtis.'> and 1- 



O Limited Fngh^h ond - 

O 

* (waj ndt tested) 



O Ch.nese 

-kz-N Phil pptne 
Din'icjs ' 

O Sp<i.'i$h 
O O^htr 



Araong-the grade-three pupij^s tested, 78.8 percent spoke English only, 13.9 
percent spoke flueht English plus a second language, 5:7 percent spoke limited 
English plus a second language,* and 1.1 percent spoke riq English (see Table 11). 
Spanish, was the predominant second language as shown inFigure 7.. A similar • 
distribution was found among grade-two pupils. From 1975-76 to 1976.-77 changes 
occurred mainly i-n the number of English-only and limited-Eaglish speakers. 
The numbers of English-only pupils declined .5 percept in grades two and three, 
^^and those of limited-English-speaking pupils -increased .8 percent in grade two 
* . and .7'pertent in grade thrjee. The petcents of fluent-English-speaking and 
non-English-speaking pupils remained virtually the same* 
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The scores of Eaglish-ona./ pupils were substantially above the statewide 
av6rig«es (see Table' 11)* Seco*nd-gv"ade pupils who spoke only English answered / 
72.0 pferce'nt of the questions correctly (68.4 percent was the statewide ^ 
, average), and 'tliird-grade pupils who spoke only English answered 84.3 percent^ 
of tha questioij^ correctly .(84.47 was the statewide average)! The pupils who 
sp6k€ ili^jit;gii5lish plus a'l^cdnd language other than Spanish achieved even 
higher scqrfis" as » shown .in Figure 8. Particul^ly ,high achievement was» shoyn 
by children who spoke fluent English plus Chitiese or Japanese. The average 
score of .s'eoond- grade qhildrei;! in those categories exceeded the third-grade 
statewide average. Fui^'ils who spoke fluent English plus Spanish had scores 
well belW the statewide averages — 59.1 percent correct in gradaTtwo and 75.0 
percent correct in grade three. The average scores of limited-^Higlish speakers 
also we^e vbelow the statewide averages. Th9se pupils who also spoke Spanish 
scored lower than.Jthose who spok^ pther languages. , 

lAt both gXadfi levels pupils of all categories of English" fluency improved • - 
from 1976-75 tO' 1976-77. The greatest gains were' made by the Chinese-speaking 
pupils, and 1:he^ smallest gains were regjsitered by the SjJanish-speaking pupils.- 

Occupation of the Breadwinner in the Pupil's Family 

Teachers were asked to designate as follows the occupational category of tlje^ 
breadwinjier in each pupil's family: . « ' 



SOCIOECONOMIC STATUS 

O ^ecuiives^ Professionals, and Managers 
O Semiprofessionols, Clfirical and Sales 

Workers, and Teohnlcians 
O Skilled and Semiskilled Employees 
O Unskilled Ennployeesjand Welfare) 
O Unknown 



The occupational- informatioi^i permitted a comparison of pupils' scores by the 
socioeconoidicf status of their parents. The results are shown in Table 12 and 
Figure 9. \ / 

In both grades two and. three, more * pafrents were Idsted'as executive/professional 
and fewer as semiprofessional and skilled/semiskilled than in 1975-76. Thirty- 
eigjit^ percent of the parents of third graders were classified a6' executive/ 
professional and semiprofessional compared to 36.6 percent of th^ parents of 
grade- two pupils. This may reflect the upward occupational progress of parents. 

Table 12 shows the considerable achievement difference between children of, 
different socioeconomic backgrounds. Grade- two children of parents in the 
executive/professional category scored higher than the, statewide average fbr ^ 
third graders. Grade- three Children of parents in the unskilled/welfare 
category scored below the statewide average for second graders. There was 
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^ difference of more than two" years' achievement betweeri *pupils of tfie highes,t 
I and lowest socioeconomic groups of the same grade level. 

' 1 ; , ^ • 

Similar differences were noted in the percents of pupils whb scored below the 
first quartile. In ^rade three, less than^^6^^^-^ercent of the pupil^ whose 
l5arents were classiNEied as ^professionals Scored below the' yrst, quartilC. ^ In*, 
contrast, alirfost l^alf (49. -4 percent) of those whose parents were clarified" in 
the unskilled/welfare category scored below tKe first quartile. Thus ^; 'a giraHe- 
three ch-ild from the lowest socioeconomic group WaSf about eight times as likely 
to score below the first quartile than one from the highest socioeconomic group. 

Pupil MobiUtv J ' - , ' 

Teachers weife asked to designat>-as follows' the grade at which' eajh child 
first enrolled in the school: ' ' ' . " 



MOBtLtTY 

AT WHAT GRAO.^ WAS THIS PUPIL 
FU^ST ENROLLCO AT THIS SCHOOL^ 



kO 

2 0^ 
30 



HAS THIS PUPIL ati-N ENflOLLEO 
IM THIS SCHOOL CO\TiNUOUSL\ 
SINCE THAT'TWME? 



YesO 



The information permitted a comparison Qf pupils' scores by the pupils' length 
of time at their school; ^ The results are shown in Tables 13 and hnd Figure 

10. • ; ^ 

Approximately half the pupils tested ^ad .not changed schools since their^ 



c.ate- 
the 



enrollment in kindergarten.- As shown in Table 13,* the children in thi 
gory included 56.1 percent of the grade-two pupils and 47.7 percent ofun^ 
grade three pupils A However, about one-fourth of the. pupils 'tes-ted had move^ 
to their current, sch^l during the year of testing (25. 6, percent of th£ second 
.gra^rs and 24.1-paxcent of the third' graders) . The lower figure for gisa^e- 
three pupils probably reflects a tendency of families to become^'less mobil^ 
as their children grow older. ^ 



The mobility rates increased in both graders between 1975-76 and.'l^76-77 (see 
Tahle 13). The percent of second-grade pupils who remained in* the same school 
since kindergarten decreased from 57.1 percent in 1975-76 to 56.1 percent\iti. 
1976-77. Third-'grade pupils showed ^similar decrease'in enrollment stabilTity* ' 
from 48.4 percent to 47.7 percent ^.n the same two years. Similarly, more 
pupils in 1976-77^ had been in their current school less than one year a^ the : 
time of testing than in 1975-76. -Fon: second-grade pupils, this number increased 
from'24.7 percent in 1975-76 to 25.6 percent in 1976-77. For tbifcKgraders , 
it rose from 23.2 percent in 1975-76 >to 24.rpercent ip 1976-77. 



Ill 



\ 



ai2 student ^Achievement in California Schools \ ^ . ^ ' 

Pupils with stable enrollAents (that Is, with longer enrollments, at the*saine 
school) generally had hi'g^iet test scores -than those with less stable enroll-^ " 
ments. Among 'grade-two pupils tliose who wet* ^enrolled In the'^same school since*^ 
kindergarten' scored 70.2 percent correct; those enrolled in the'same school 
since grade one scored 67.3 "percent eorrect^; and those who we're eni;olle^ in 
the same school since grade two scored 65*5 percent.-^ The patterns ^ere^siitfllar 
for tRicd graders.' Grade-three pupils who were in the same school .since^ kinder- * 
garten scored 83.6 percent correct; those in the same school since grad^ *one^ 
scored^Sl.S percent correct;' those, in the same school since gradje two scored . A 
80.^ perjcfent correct;" and those in the same 'School since gradfe three scored 
78.8 percent correct. " ' - - . 

Part of the pattern of higher achievement among the pupfls with'^more stable 
enrollments can be attributed to the 'fa.ct ^that children from families of^ 
higher socioeconomic level, whose 'enrollments are" generally mor€ stable, ^Iso 
tend to score higher. Vs^Qiis can be se»n -in Table 14, ^ich intflCides figures for 
both sdcioeconomic status^the occupaition of the breadwinner in Jthe pupijjL's 
family) and mobility. Table 14 and KLgure 10 *how that mob^^ty is only.^mildly 
related to pupil achievement. ^ It is tru^ that the children of the highest- ^ 
mobility group within each socioeconomic cagetory had both the lowest mean^ 
test scores* and the -largest representation among pupils who scored beldlg^ £he 
first quartile and that achievement usually is directly proportional to^the 
time that a child is' enrolled in the school, however, the scared of children " 
in different socioeconomic groups are profoundly different;, they do not eVen '/ 
overlap. ^ For exampl^ the most mobile chiliJren' <tHose who enrolled in gtade ' 
three at their present school) of -parents classified as execi^tiVe/professional 
still outscored the most stable pupils (those in the same school' %ince kinder- . 
garten) of the next lower Socioeconomic group (children of parents in the 
semiprofessional oategory); jThe^sarae holds triie for the, other socioeconomic- ^ 
groups. Furthermore, the gap l^^ween any two spcioeconomic groups was greatSi: 
than the spread of scores within each group. For example, the difference 
between the most and least mobile pupils in the unskilled/welfare group was 
5.7 percent (the difference between 71.4 percent and 6^.7 percent). This was 
still less than the' 8.5 percent gap between the least mobile pupils in, the * 
unskilled/^welf are" group (71.4 percent) and the most'mobile pupils in the 
skilled/sfemiskilled group (79.9 percent). These d^ta show that whil^ 'mobility^ 
does affect pupil scores, its impact is almost trivial da comparison to that . - ^ 
of socioeconomic level(;of th^ pupil's family. ^ . ' , . 

From 1975-76 to l^lb-ll the children of higher mobility made greater: achieve- 
*ment gains than did the children of more stable enrollments, as. shown in 
Table- 13. This narrowed the gap between the scores of the two' groups . In ° 
grade two the children who were enrolled in the same school sin^e kindergarten 
gained .8 percent, while tjiose ^enrolled in the same school since second grade 
gained 1.2 percent. In grade thr^ the ch-ildren who^ere trolled in the same^ 
school since kindergarten gained .2 percent, while ttvose .enrolled in 'the same' 
school sinc^ third grade gained .9 percent. ^ ^ " ' . . - 
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Table 10 












Reading Test" Scores bv Sev 
1'975-76-and 1976-77 








m 

Sex 


Percent of • - ^- 
. Population 


Mean Readlnj^^ ' 
Test Score 


Percent Scoring 
. Below First Quartlle 
' on the Readlnc Test 




c. 


Grade 2 


Gradft*3« 


Grade 2 


Grade 3 


Grade 2 
















* 






Boys . 1975-76 




49,9 


65.2 


79 5 


i^O • J 






^ 1976-77 


50.0 


49.8 . 


66.1 ■ 


.79.9 • 


28.2. 


28.5 - 




Difference (1977-76),, 


(-0.3J^ 


(-0.1) 


(40/9) 


^ (+0.4)- 


' (-0.1) 


(-0-) • ' 




Girls 1975-7B" 

" 'i 


. 49.3 , 


49.6- 


70.0 


8^.2 


21.6 


21.4 / 




1976-77 ' 
Difference (19?7-76) 


'49: 1 

(-0.2). , 


4^.5 ^ 


70.9 

■r 


83 ..5 ' 

, (+0,3) 


21.7 ^ 
(+0.1)^ 


21.4 : . 
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Table 11 

Reading Test Scores by English Language Fluency and Other Latiguage Spoken • 



English 

Language 

Fluency 



State Total 
English Only 
Fluent English* 



Limited Engfish" 



Non-English 
Speaking 

Non- Response" 



Other 
Languages 
Spoken 



Chinese 

Japanese 

Philippine 
Dialects 

Span,ish 

Other 

No Response 
TOTAL 

Chiiusse 

Jap^ese ' 

^Philippine 
Dialectr 

Spanish 

Other 

No Response 
TOTAL 



Percent of Population 



Grade 2* 



75-6 76-7 



100.0 100.0 
79.2 78.7 



.5 
.4 



.7 


.7 


. -7 


9.2 


9.2 


J.0.3 


1.4 


1.5 


1.6 


.2 


.2 


.2 


12.4 


12.4 


13.8 



.z 
.1 



.7 
.1 



Grade 3 



75-6, 76-7 



100.0 100.0 
79.3 78.8*^ 



.6 
.4 



>6 
.4 



>2 



.2 
.1 



Mean Reading Test Score 



Grade 2 



75-6 76-7 Difference 



67.7 
70.9 
80.5 
8*2.3 

74.5 
58.1 
73.0^ 
62.8 
62.5 

56.5 
65.9 



68.4 
72.0 
81.9 
82.8 

75.6 
59.1 
74.2 
63.3 
63.5 

60.2 
66.1 



+ .7 
+1.1 

*+3r»4 

+ .5 

+1.1 
+1.0 
+1.2 
+ .5 
+1.0 

+3.7 
+ .2 



.2 


.2 


.2 


.2 


57.0 


60.0 


+3.0 


5vl 


5.8 


4.1 


4.7 


42.1 


42.3 


+ ;2 


.5 


.6 


.5 


.6 


50.4 


53.3 


'7+2.9 


.1 V 


.1 


.1 


.1 


46.4 


42.8 


-3.6 


6.2 


7.0 


5.0 


5.7 . 


44.1 


44.6 


+ .5 


1.4 


lA 


1.1 


1.1 


29.1^ 


29:1^ 


-0- 


.8 


.4 


.8 


» 

.5 


68.6 


68.9 


+ .3 



Grade 3 



75-7 76-7 Difference 

+ .3 
-0- 

91.1 +1.8 
91.8 s + .1 



81.4 
84.3 
89. J 
91.7- 



81.7 
84.3 



Percent Scoring Below the 1st Quartile 
on the Reading Test 



Grade 2 



75-6 76-7 Difference 



85.6 
74.5 
85.5 
79.1 
77.5 

70.7 
77.2 

70.4 
54.5 
59.5 
57.4 
56.4 



87.5 
75.0 
86?1 
78.3 
•78.1 

71.9 ^ 
78.3 



+ .5 
'+ .6 
- .8 
+ 

+1.2. 
+1.1 

+1.2 . 



71.6 
53.8 
63.6 
56.3 .9 
56.2 , - .2 



+4.1 



29.1^ 29.1^ ^'-0- 



81.1 82.5 +1.4 



25.0 25.0 

19.8 19.3 

8.4 5.9 

r 

5.5 . 5.1 

1117 '11.7 

36.8 36.8 

16.0 15.1 

30.9 33.9 
30.8 30. 6» 

38.3 35.9 

22.8 23.6 

37.8 34.0 

67.3 ^8.0 

40^9 45.7 

62.1 68.7 
63.3 *63.6 



-0- 

- .5 

-2.5 
_ .4 

-0- 
-0- 

- .9 
+3.0 

- .2 

-2.4 
+ .8 

-3.8 
+ \1 
-3.2 
+6.6 
+ .3 



100.0^100. 0^ -0- 



23.2 22.8 - .4 



Grade 3 



75-6 76-7 Difference 



25.0 25,0 
19.7 19.2 

9.9 7»4 
6.. 4. 6.2 

16.6 13.3 

38.3 .38.6 

17.3 16.6 

30.5 33.1 
3C.6 >2.5 

45; 9 46.2 

34.1 ^Zl^ 

46.6 45.5 
74.3 76.6 

68.0 60,7 

68.1 69.7 
71.3 72.6 



100.0^100.0^ 



25.4 23.4 



1^-2.5 
.2 

- -3.3 
'+ .3 

- .7 

- .1 

+ .3 
-2.0 

-1.1 
•+2:3 
-7.3 
+1.6 
+1.3 

-2.0 



^ Value less than O.05 percent 

The computed chance score for pupils-^iStKrWere unableT to takte the test. 



1 

^ 



Fig. 7. Distribution of California thinJ g^de pupik according to Engii 
langu^e sp^l^.as coded by their |^chers* « - 



ngbage fluency and other 



Englishlanguage 
fluency , 



Percent correct. 1976'7 



30 40 50 60 70 80 90 100 

2 1-_ 1 L^^ 1 I 1 |__ 



Change fro^^975-76 
^ to \916^1 



j.4 -3 t2'-I 0 tl +2 +3 +4 



State total 

English only 

Flyent English total 
Chinese 
^Japanese 
' .Philippine dialect 
Spanish 
Other • . 

Limited English tota> 

Chinese 
* Japanese^ 

^Philippine flialect 

Spanisfi 

Other ."^^ 





Fig-^S. Reading Test scores by English language fluency and other language spoken « grade thre6 



Table 12 o< 
Reading Test Scores by Occupation of^ Principal Breadwinner in Pupil's Family 



Occupation of 
1^ , Principal 
Breadwinner 



State Total 

i.'. • . 

Exef utive, * _ 
Professional or 
Manager * ^ 

Semiprofessional, 
Clerical or Sales 



LOO.O 100.0 



IS. 3 15.7 



Worker, or Technlci&n 



Skilled or Semiskilled 
Employee ai 



Unskilled Employee \ 
(or m!'*Nelfare) 

Unknown x ^ 



No Response 



7~ 



Percent of Population 



Grade 2 



75-6 76-7 



21.3 20.9 



36.5 36.3^ 
1^.5 l^l 

« 

•1.3 f.4 



Grade 3 



75-6 76-7 



tOO.O 100.0 
15.9 16.5 

21.8 21.5 

36. a 36.4 

18.1 18.2 

} 

5.9 6.0 

• I, ' 
1.5- 1.4 



Mean Reading Test Score' 



Grade 2, 



75-6 76-7 Difference 



67.7 68.4 + .7 
83.0 83.7 " +,.7 

75.8 76.6 +^ ,8 

• . f' 

66.0 67.1 



52.9 53.8 • +^9 



56.6 56.8 + ,2 



65.9 65.6 



.3' 



Gtade 3 



75-6 76-7 ' Difj^rence 



81.4 81.7 + .3 
91.9 92.1 / + .2 

87.8 88. 1, + .3 



81.0 81.4 +^.4 



68. 1 68.*7 ' + .6 



71.^ 71.5 



80.3 79.2 -l.l 



Percent of Pupils, Scoring Below 
First Quartile 



Grade. 2 



75-6 76-7 Difference 



25.0 25.0 



6.1 6.0 



-0- 



12.5 12:4 - .1 



25.4 25.2 



47.6 .47.6 



.2 



41.9 43.0 -+1.1. 



27.1 28.8 +1.7 



Grade 3 



75-6 76->7 Difference 



25.0 25.0 



-0- 



6.1 6.2 + .1 X 



12.8 12.6 - .2 



25.4 25.5 + .1 



49.7 49y4* - .3 



42.7 43.2 + .5 



26.7 29.5 +2.8 



erJc / 



Occupation of 

principal 
breadwinner 



GRADE 2 

State total 

Executive, profes- 
sional, oi^^ma^ger 

Semiprofessional, 
clerical or sales 
worker, or 
technician 

Skilled or semi- 
skilled employee 

Unskilled employee 
(or on welfare) 



GRADE 3 ^ 

State total 

Executive, profes- 
sional,or manager 

Semiprofessional, 
cleiical or sales 
worker, or 
technician 



Skilled or semi- 
skilled employ^ 

Unskilled employee 
(or on welfare) 



Percent correct, 1976-77 



30 46 50 60 70 80 90 100 




Change from 1975-76* 
to 1976-77 



-4 -3 -2 -I 0 +1 +2 +3 +4 



I 



^ 0. Reading Test scores by occupation of principal breadwinner in pupil's family , grades two and three 
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Grade of enrollment 
by 

sodoeconomic index > 
^occupational 
category of principal 
breadwinner in child's 
family}\ 

Executive, profes» 
sional or manager 
' Kindergarten 
^ " Grade 1 - ^ 
Grade 2 ' ' - 
Grade 3 



Percent correct, 1976-77 



30 40 $0 60 70 80 90 rlOO 



Semiprofessional, 
clerical or sales 
worker or techi\ician' 

Kindergarten 

Grade 1 

Grade 2 ^ 

Grade's 

Skilled or semi- 
skilled employee , 

Kindergarten 

Grade 1 

Grade 2 • 
' Grade 3 



Unskilled employee 
. or on welfare ' 

Kindergarten 

Grade 1 

Grade 2 

Grade 3 



Fig. 10. Reading Test scores by socioeconomic index and grade 
of enrollment, grade fhree, 1976-77 
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Table 13 ^ \ 

\ 

Reading Test Scores by Mobility Rate 



Grade in Which ' 

Punil Was 
Enrolled in 
School of Testldg 


Percent of Population 






Mean Reading Test 


Score 




Percent of Pupils Scoring Below 
First Quartlle 


Gr^de 2 


Grade 3 


Grade 2 




Grade 


3 




Grade 


2 


Grade 3 


75-6 76-7 


7 5^6 




75-6. 


76-7 


Difference 


75-6 


7 A- 7 
/ 0- / 


Dif f e reiice 


75-6 


76-7 


Difference 


75-6 


76-7 Difference 


State Total 


100.0 100.0 


100.0 


100.0 


67.7 


68.4 


+ .7 


81.4 


81.7 


+ .3 


25.0 


25.0 




25.0 


< 

25.0 


-0- 


Kindergarten 


57.1 56.1 


"'48.4 


47.7 


69.4 


70.2 


+ ;8 


'83-^*4 


83.6 


1^.2 


22.0 


22.3 


+ .3 


21.5 


21.7 


+ .2 


Grade 1 


17.1 17.5 


13.1 


12.6 


66.2 


67.3 


+1.1. 


^8K3 


81.3 


-0- 


27.1 


26.6 


- .5 


25.0 , 


25.9 


+ .9 


Grade 2 


24.7 ,25.6 


14.3 


14.8 


64. 3^ 


65.5 


+1.2 


80.2 


80.6 




30.3 


29,7 


- '.6 


27.0 


27.0 


-9- 


Grade 




23.2 


24.1 






-b- 


77.9 


78.8 


+ .9 








30.8 


29.7 


-1.1 


No Response 


1.1 * .8 


.9 


.8 


64.4 


65. 6> 


+1.2 


76.5 


78.6 

— : :<5— 


+2.1 


•28.8 


30.1 


+1.3 


34.0 


31.5 


-2.5 

iT 




\ 



Table 14 



Reading Test Sco.res by Socioeconomic Status 'and 

Gr^de Three 
/ 1976-77 



Occupational Ca;t:egory 

. of / . 
Principal' Brt^^inner 
in Child^s Family 



'Grade in Which 
^ Pupil Was Enrolled 
^ in School of Testing 



Percent^ of • 
Occupational 
Category 



Executive , -Professional 
or Manager 



'Semiprof essiohal , 
Clerical or Sales 
Worker or Technician 



Skilled or- Semiskilled 
Employee 



Unskilled Employe'^e 
or on Welfare 



Kindergarten 
Grade 1 * 
Grade 2 " 
Grade 3 



Kindergarten 
Grade ^ 1 - 
Grade 2 
Grade 3 



• Kindergarten 
Grade 1 / 
Grade 2 
Grade 3* 



Kindergarten 
Grade 1 
Gradje 2 
Grade 3 



53.5 
12.9 
13.9 
19.7 



49.5 
12.5 
^14.9 
23.1 



50.1 
12.4 
^14.5 
23.0 

41.6 
13.4 
16.1 
28 .'8 
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Rate 



Percent of Pupils 
Scoring Below 
First Quar.tile 



5.4 
5.6 
7.0 
8.1 



11.4 
12.6 
13.7 
14.5 



23.5 
26.9 
26.7 
28,0 



4l4 
50.2 
51.7. 
53.1 




A School-Level' Analysis of Achievement and background Factors, 
I ^ Grades Two and Three * * o 

This section contains an anralysis of Reading Test results for grades two and 
three. In the analysis, the average achievement levels of entire schools are 
^ considered. In this way comparisons can be made of changes that, occurred 
among. schools with different background characteristics. This school-level 
^analysis complements the pupil-level analysis, in which test results were 
considered oh the basis of individual pupil characteristics. The reader is 
reminded of the need for caution in interpreting* the findings presentrfed in 
this section,; as pointed out in the beginning of this chapter^ 

The following is a summary of the findings in the school-level analysis: 
Sumnary of Findings v ' 

1. Schools at all achievement levels, that is, those in the lower, middle, 
and upper ranks, gained over last year. In 1975-7^ only the upper half 
of all schools had. higher scorqiP than the yeaf before. All schools 
except those with the- very lowest scores regained =the losses suffered 
in 1975-76. '^e greatest gains - appealed to have been made by those 
schools around the average for grade two and J:hose in the lower .middle 
range for grade three. 

2. Scores on the Entry" Level Test , a school-readiness test given to children 
as they enter grade one, wer^, closely related to the ^rade two and grade 
three Reading Test scores. The -substantial achievement gap between 
schools with th^ highest and lowest average Entry Level Test scores' did 
no,t appear to be^ widening. . • . 

V ' 

3. - Schools with low average socioeconomic levels did much more poorly on 

the Reading Test than schqols with high average socioeconomic- levels. 
, Although the* gap bet^en such schools was about the same in grades two ' 
and three, it increased for both grades between 1975-76^and 1976-77. ' 

4. The size of a school appeared to have minimal impact on reading achieve- 
ment level. ^ . ' 

> . - ■* 

5. The schools with the Idwest concentrations of bilingual students s,c1>r.ed 
better than did those with the highest concentrations ,of bilingual^ 
students. The schools with the fewest bilingual students made greater 
achievement gains between 1975-76 and 1976-77 than those with* the most 
bilingual students. 
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6. The schoc^s with large percientages pf children from families receiving 
Aid to Families ^ith Dependent^ Children (APbc) scored more poorly than 
those witl: small percentages of such children; Further,^ as children 
moved, frort grade two to grade three\ those in schrfols with lai?ge per- 
centages if childten from APDC families fell further behirid' in reading 

f achievement, ^ ^ 

7. The schools in elementary school districts scored higher than those in 
unified school districts and showed greater achievement gains beytween 
1975-76 and 1976-77. 



Method of Analysis 

Just as in pupil-level analysis, figures a^ presented in this section for 
grade-two and grade-three pupils del both 19^5-76 and 1976-77. School achieve- 
ment levels ^re expr'essed in mean percent cOTCect scores .in Table 15 and in 
percent scoring befow the first quartiie in TAle 16. Schools are divided 
into five grouj)s bf apprpximately equal numbers, for eacix background factor. 
The distribution of pupils .among these five equal g^ups is shown in the 
•"Percent of Pupils" column of Table 17. One can see where there exist greater- 
-than-ayerage concentrations of pupils with each background characteristic. 

Percentile Level Analysis ' 

School percent correct* scores increased from 1975-76 to 1976-77 in both grade 
two and grade three, as one would expect from the rise in pupil- level achieve- 
ment.' However,, the gains were more pronounced when viewed at the school' level, 
i/hile the. mean pupil percent correct scdre increased .7 percent in grade two 
and .3 percent in» grade three, the scores of the median school, in the state 
increased 1.4 percent in grade two (from ^.0.2 £o *71.6) and .7 percent in grade 
three (from 84.4' to 85.1). All schools, however, did not gain equally- Table 
18 shows that the lowest- scoring schools in both grades two and three (those • 
at the 5th percentile), reversed the downward trend of the previoqs^year and 
made small gains in 1976-77. However, these schools. still were below their 
levels of 1974-75. In both grades, the greatest gains in 1976-77 were made 
by schools of somewhat below-avenage achievement., In grade two the schools at 
the 30th and 40tK .percentiles each gained nearly 2 percent from 1975-76 to 
1976-77. In grade three the schools at the 10th and 20th percerttiles gained 
1.3 percent and 1.2 percent, respectively. 

These scores <iiffered somewhat from the results' of 1975-76. At that time low- 
scforing schools showed losses from the previous year, while high-scoring school 
showed gains; Thi& led to concern over a "widening of the gap" between high- 
achieving and low-achieving schools. -The results for 1976-77 indicated that 
in gr^de three this gap did not increase, liv grade two in L976-77, the lowest- 
achieving schools did not gain cjuite as much as those above them; thus*, the 
gap increased slightly. * 

♦ » • 

Entry Level Tes t Score 

' ^ . ^ ' . 

The Entry Level Test is a school- readiness test* given to all* grade one pupils 
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'in the state diH^g their first month pf school. It provides baseline data 
against which grade •two. and grade three Reading Test results are ^compared. 

^ *TaSle 17 shows that, with schools distributed in five equal groups j'^pupil^^ 
. beginning reading ability was unevenly distributed. The lowest 20 percent of 
schools in 1976-77 contained nearly 25 percent**of all pupils. This iadicated 
that ^the lowest- scoring schools had large* pupil enrollments^ a finding discussed 
in more detail in the section on school size. _ o • 

The number of schools achieving St the highest and lowest levels on the Entry 
^ Level Test increased between 1975^-76 and ^1976-77. This is shown in Table 17 
by the greater percents of schools that scored above 29.50 dr helovi 25.42. in 
1976-77 than in 1975-76. 



The scores made on the Eiltry Level Test were closely related to achievement on 
the later 'Reading Test in grades two and three/ In fact, the Entry Level Test * 
scores and a school's socioeconomic' level were the two highest correlates of 
Reading Test performance. Tables 15- and 16 show the relationship between - 
Entry Level Test scores and Reading Test achievement. Figure 11 portrays this 
relationship graphically. For instance, in 1976-77, the schools within the 
highest one-fifth of Entry Level Test -scores had average grade three Reading 
Test scores of 90.4 percent correct. In contrast, the schools in the lowest 
one-fifth of Entry Level Test scores averaged pnly 69.2 percent correct oti the 
Reading Test . .Likewise, among the schools in -the highest onerfifth on the Entry 
Level Test , less than 10 percent of the pupils were below the first quartile on 
the Reading Test , as shown in Table 16. In contrast, in schools in the lowest 
one-fifth, almost 50 percent of. the pupils scored below the first quartile on 
the Reading Test . Thus, seemingly small differences in EntrV Level Test sco^res 
were reflected as substantial differences on the Reading Test . 

Table 15 also confirms' |||||||^ the greatest gains between 1975-76 4nd 1976-77 were 
made by schools just below the statewide average. Here, schools , In the 25.43 
to 27.22 and, 27. 23 to 28.46 groups gained the most in bcJth grades two and three. 
The gains of the lowest and highest groups were similar. 

Table 16 shows that the percents of pupils^ho scored below the first quartile 
on the ^ Reading' Test remained about the same for each group between grade *two^ 
and grade three in 1976-77. This ^indicated that there was no widening of th* 
gap in achievement between the highest-scoring and lowest-scoring .pupils as they 
progressed from grade two to grade three and that^ they remained in about: the ^ 
same relative position. , 



Socioeconomic Index 



A school's socioeconomic status was determined from information, provided by 
teachers regarding the occupation of the principal breadwinner in fchJ'pupil's 
family. For the school-level analysis, the data were averaged across e^ch 
school to produce aj school sociMconomic index. The index ranged from a^low 
socioeconomic level of 1.0 to a nigh Of 3.0. 

Tabl^- 17 shows that a school's socioeconomic le^el„and its size were not, directly 
related. Thus/vrtiil'e the* schools of the lowest socioeconomic level had a dis- 
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proportionately large number of pupil^s, so did, thoj^e of the highest socioeconomic 
level. The schools in the middle of the range were smaller. Additionally, 
the discrepancy* between the percent of schools in a socioeconomic category and ^ ' 
the percent of low socioeconomic level pupils ih them (for example^ jt^e lowest.' 
19.5 percent of schools in 1976-77 contained 21,4 percent of all Pupils) was 
less than the discrepancy for Entry Level Test )scores (where the lowest 20.0 
percent of schools contained 24.7 percent of the pupils).- ^ 

Statewide, the socioeconomic leyel ^increased from 1975-76 to 1976-.77, as ^rioted ^ 
' earlier. In 1975-75, 20.^0 percJent of the schools had socioeconomic indexes of 
1.76 or below. ' This figure decreased to 19.5 percent in 1976*- 7^. Similarly, 
schools in *the highest status category increased from 19.9 percent to -20.3 * 
percent, • . * 

Like the Entry Level Test score,> the socioeconoiiiic status of a school: had a 
high correlation with grade two and grade three 'reading achievement. Most of 
%the findings about the effect of Entry Level Test scores, reported in the last * 
section,' also held true for socioeconomic status. Tl\e schools near the state- 
wide average in socioeconomic status made the greatest gains' between 19.75-76 
and 1976-77. In-the schools in the lowest 20 pe^rcent in socioecpnomic status, * 
, more than five times as m'any pup^s scored below the /irst quartile than l;hose 
of the highest lO percent in socioeconomic status. The achie^emgn* gap between 
schools of high and low socioeconomic level remained about the same between - 
grades two and three. The only observa&leVdif f^rence between dividing schools 
on the basis of socioeconomic index and dividing them on Entry Leve^ Jest score, 
is that- the achievement gap between high andN,ow socioeconomic schopls widened 
between 1975-76 and 1*976-77. No such widening was reporte^lbetveen schools 
with the highest and lowest Entry Level Test scores. In perc^t- correct scores^ 
the lowest socioeconomic status schools gained •. i 'percent in both grades two 
and three. The highest- level schools gained .7 percent in grad% two ^ind .3 
percent in grade three. While this widening 6f the gap was small, it wS^ sig^^ 
nificant that it appeared when scores were dnal3F2ed by socioeconomic; level but 
not when analyzed by Entry Level Test scores. *' ' , - • " . 

School Size 

School size was reported terras of the number^f pupils who took the Reading 
Test at each grade level rather than the overall; enrollment, of a^^chbol. 
^ ^ In Tables 15 and 16, these schools are divide^ iato five categories of size; 
each having approximately, the same n6mber of schools. ' ' * 

\^ The smallest schools had the highest test sco'res^ as reported in. Table 15. As/ ^ 

Marger and larger schools were studied, only gradual declines in scores "were 
noted (see Figure 12). However, the largest schools scored substantially 
below the others. The smallest schools also achieved the greatest gains be- 
tween 1975-76 and 1976-77. Their percent correct scores increased* 1 . 2 percent 
in grade two and ^7 percent in grade three. The'large?t schools gained ,5 
percent in grade two and lost .1 percent grade three. ' - C . , 

^ ^ The, relationship between school size and Reading. Test achievement was ^ot 
X entirely clear. Large schools, which scored lower than small schools,' generally • ^ 
also had lower Entry Level Test scores and greater number^ of pupils from 
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families receiv^n^ Aid .to Families with Dependent Children. Both of theses Tast . 
two factors are associated] with lower jreading achievement. However, it is not 
accurate to characterize large schodls only by these two background factors; " ' 
schools of both\the lowest and highest socioeconomic levels tended to i>e large 
schools, as reported in the seqtion on socioeconomic status. Therefore, the 
impact of school size per se on feading achievemervt probably was minimal,' or 
at least considerably less than the Entry Level Test scores or socioeconomic 
status. 



English Fluency ^ „ - . * 

Information on the pupils' bilingualism was provided By teachers at the time 
they Administered the Reading Test . All pupils who spoke English, and a second 
language and those classified as noii^English speaking were characterized as 
bifingual for the purposes of this report. Tables 15, 16' and 17 show the 
schools divided into five approximately equal groups and the concentration of 
bilingual pupils in each. 

The schools with few bilingual pupils tended to be small in size, as shown in " 
Table 17. The percent of schools having low concentrations, of bilingual 
pupils (0 to 3.5 percent) decreased between 1975-76 aod 1976-77, while the 
percent having ^igh concentrations (29.7 percent and above-) increased. This 
is consistent with the pupil- level figures, which showed a decrease in the 
percents of pupils wtp spoke English only.- 

Hie schools with the fewest bilingual pupils scored highest on the Reading Test , 
as shov^ in Table 15 and Figure 13. There were .substantial differences in 
scores between schools having- the highest and Ipwest percents of bilingual' 
pupils, although these achievement differences were' not as pronoyfticed as those 
between the^ highest and lowest schools in either Entry Level T>§t scores or ^ - 
socioeconomic level. The pupils -in the 20 percent of schooTs^ith the greatest 
bilingualism were three times as likely however, ta score below the first 
*quartile than the pupils in the 20 percent o^ schools with the least bilin- 
gualism. 

The schools with the fewest bilingual pupils achieved the greatest gains in 
reading scores between 1975-76 and 1976-77. Schoof gains became less as the 
concentration of bilingual pupils increased. However, the relative achievement 
levels of schools in the five bilingual categories remained fairly constant ^as 
pupils progressed from grade two to grade three. This i*s shown in Table 16. 



Percent of Pupils from Families Receiving Aid to Families with Dependent 
Children • ^ ^""^--v^^^ 

During the 1976-77 year each school reported the number of its pupils that 
were from' families receiving Aid to Families with Dependent Children (AFDC). 
An AFDC rate was computed by dividing that* number by the school's total enroll- 
meiit. Tables 15, 16, aiS^17 show the schools divided into five approximately 
equal size groups and the relative concentration of pupils from AFDC families. 

Schools with high AFDC rates tended to be larger schools, as shown in"^ Table 17. 
The AFDC rate decreased from 1975-76 to 1976-77, which was reflected in an 
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increase in the p^cent of schools having low (G to S.5 percent) AFDC rates and ' 
a decrease in those with high (24.6 percent or higher) rates. * 

AFDC rate was the third highest correlate of Reading Test scores, after Entry 
Level Test scores and socioeconomic status. As one would expect, the cor- 
/ relation of the AFDC rate with e%ch of these latter two factors was high. 
However, an analysis of the AFDC breakdown provided two additional -bindings ' ' 
($ee Figure 14).' First, test scores droppe^d sharply between 1975-76 and 1976-77 
among schools having a fairly high AFDC>ate (the. 14^.6 to 24.5 percent category), 
as shown in Table 15. Grade twor scores fell 1.1 percent and grade three scores 
dropped ••9 percent. In grade two all^'otHer groups made modera^>* progre^*r» 
In grade three-, however, there was a trend for the schools wi.th the highest 
concentration of, pupils from AFDC families to make less progress. 

Second, the achievement gap between the schools with the greatel^ concentrations 
of pupils from AFDC families and the other schools increased somewhat as children 
moved from grade two to grade three. Table 16 shows that the percent of pupils. 

, scoring below the first quartile increased between grades two and three for the 
schools with the -highest percent AFDC (those with rates of 24.6 rfr higher), 
v^ile the percent either declined or increased at a lower rate in the other 
f^uf categories. This finding is just the opposite of that in the ar^alyses 
"Sing Entry Level Test scores or socioeconomic status. While these other 
factors showed rio evidertce of widening the achievement gap, the AFDC figures 
show that 'children in high percent AFDC schools -^ere slightly farther behind 

^their peers^ at' the end of the third grade than at the end of the second grade. 

Elementary or UnjLfied Sfchool 6'lstrict 

In California, elementary schools belong to one of two types of school distripts: 
elementary or unified. Elementary school districts include kindergarten through* 
grade eight (at \^icb time the pupil moves up to"^ a high school district). 
Unified school districts include kindergarten through grade twelve. There is 
a very general trend for un^^^ied districts to be in urban and suburban areas 
and for elementary districts to be in rural areas. * f 

More than two- thirds of the grade two and gra^ three pupils tested were enrolled-, 
in unified districts. ReaAng Test scores were higher for, second- and third- 
grade pupils in elementary districts than for those in unified districts in- 
1976-77. Additionally, the scores of pupils in elementary districts increased 
more ftom 1975-76 to 1976-77 than those of pupils In unified districts. 
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Readini^ Test Scores for All Schools According to Entry Level Test Score, Socleoeconomlc Index* Size, 
Percent Bilingual, Percent AFDC and Type of School District 
Grades Two and Three, 1975-76 and 1976-77 
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tercent^of Pi^lls in California Scoring 'Below First Quartlle 
on Reading -Test , 1976-77, Reported. by Categories of Schools 
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Table 17. ' . - 

Perdent of Schoola and Pupils in Various Categories, 

Grade Three 
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Table 18 

Reading Testr Scores for Schools at Various School Percentile Ranks 
Grades Two and Three, 1974-5 Through 1976-77 
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Fig. 1 1 Reading Test scores for all schools according to Entry Level Test score, grades two and three, 
1975-76 and"1976-77 
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Fig. 12. Reading Test scores for all schools according to number of pupils tested per grade, 
grades two and three, ^975-76 and 1976-77 
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Fig. 13. Reading Test scores Yor all schools according to percent bilingual pupils, grades two and three, 
' 197 5-76 and 1976-77 
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Fig. 14, Reading Test scores for all schools according to percent of pupUs receiving aid to families 
with dependent children <AFDC), grades two and three, 1975-76 and 1976-77' 
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A Student-Level Analysis of Achievement and Background 
\ Factors, Grades Six and Twelve 

As part of the administration of the Sjurvey of Basic Skills.; Grade 6 . teachers 
provided information on the English language fluency of each sCudent and about 
any second language that each student spoke/ The test results were analyzed 
.to determine any differences among the groups of students. 

Summary of Findings . • ' ^ 

1. ; Reading and math .test scores were higher for students who spoke ^glish 
only than for tho/se who spoke fluent English and another language. 
^However, the' scores of the students who spoke fluent English and a 
language other than Spanish scored higher than thpse students who spoke 
• English only. 




2. ^ The reading test scores of the students wh^ spoke English, onfy did ^ot 

change, wherea's'the reading scores of the students \Ao spoke fluent 
Bnglisli and limited-English declined., ' The mathematics test scores of 
students who^spoke English only and those who spoke fluent English and 
another 'language improved , more than those for limited-English speaking 
students. ' • • , 

3. Girls score higher than boys in reading and boys perform better than 
^girls in mathematics, at both 'grades six and twelve. The relative 
differences were about the same as in 197^6. ; ' 

Analysis of Findings * - - 

English Language Fluency . The grade-six teachers indicated on each pupil's 
booklet the pupil's fluency in English and any other language that the student 
spoke. Figure 15 shows the pqrcents of pupils that fell within the various 
otttregories of fluendy in English and the percents of the students who spoke * 
other languages. The reading and mathematics scQres,,by fluency in English and 
language spoken, are presented in Table 19 and are shown graphic'ally in Figure 16. 

There was an overall decrease of .2 percent . correct in the reading scores in 
1976-77 from that of 1975-76. The data for reading show that all subgroups 
did not follow the statewide trend; the scores of the students who spoke only * 
English, did not <?nange. Although the scores of the students who spoke fluent' 
English and another language decreased overall, the scor es o f those whose 
other language 'Oas Chinese or a^Philippine dialect increased. .This -means that 
much of the drop In 'the scores of the students who spoke fluent English and / * 
Ifnother- language w^s the result of the scores of those students whose other ^ 
language was Spanish. This^was so because of the lower-than- average scores of 
the 'students who spoke fluent English and Spanish, who comprised two-thirds 
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of the^students in this category:^ The aame is true In the limited* English and ^ 
ot^her language category— the decrease in the scores for those who spoke Spanish • 
accounts fqr most of the decline in the category as a wholS. s - • * 

In mathematics, tlie overall sc9re increased by .3 percent in 1976-77 over that 
of 1975-76. ' The mathematics scores of students who spoke English onrly and* 
those who spo.ke fluent English and another language impr^ed In 1976-7#f ^ • 
Hol^ever, the scores remained essentially unchanged for limited-Englis^speaking 
students. Tabl^ 1^ shows that in both 1975-76 and 1976-77, the mathematics 
scores of the students who spoke English only exceeded-the statewide averages 
and that the dcoi^es of the students who spoke f luent^English and another 
language were/b^low the statewide average. The bi^eakdown' of scores in Table 19 
and Figure 16 reveals that the lower-than- statewide average of students who 
spoke 'fluent English and another language was due to the students (77 percent) 
whose other language was Spanish. It is also interesting to note that limited- \ 
English students who spoke Chinese and. Japanese (a very small number statewide) \ 
scored above the English-only students^ ^ 

Sex Differences. The sex of each pupil was coded on the test booklet at the 
time of testing. Table 20 shows the scores for reading and mathematics by sex 
for grades six and twelve. * 

It can be seen that girls do better than boys'in reading, especially at grade 
^Six. The statewide average in reading declined Slightly at both grades. Girls 
declined v^ry slightly more than boys at grade six and vd*y slightly 1-ess at 
grade twelve. * * 

» 

Table 20 also shows that boys do better than girls in mathematics at both grade 
levels. Contrary to reading scores, the greatest difference is in grade twelve, 
where boys do ^nsider^bly better. Since 1975-76,. scores for both boys and ' 
girls improved- in grade gix (boys very slightly more) and declined in grade 
twelve (girls vefy slightly more). 
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Fig. hS. Distribution of California gradi^m students according to Eqglish langustge fluency and o 
language spoken, as coded by their teachers 
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Jeig. 16.' Survey of Basic Skills reading sc.cfres by English language fluency and other language 
^oken.grade six, 1975-76 and 1976-77 » 
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Survey of -Basic Skills Scores for Reading and Mathematics by English Language Fluencx 
' Grade Six " . 

1975-76 and 1976-77 ■ 




State Total 
English Only 
Fluent English 



Limited English 



Chinese 
Japanese 

Philippine Dialect 

Spanish 

Other 

Total 

Chinese 
Japanese 

Philippine- Dialect 

Spanlsh^ 

Other 



.5 
.3 
.6 
10.4 
1.7 

3.2. 

.1 
.0 
.1 
2.6 



73.4 
76.6 
64.3 
55.7 
66.?, 

38.7 

43.9 
44.5 
44.4 
.38.0 
39.4 



73.9 
76.2 
64.9 
55.5" 
65.7 

37.8 

43.4 
52.3 
47.2 
36.7 
39.1 



+ .5 

- .4 
.6 

- .2 

- .6 

- .9 

- .5 
+7.8 
+2.8 
-1.3 

- >3 



69. 
68. 



.58.0 
49.3 
58.8 



.43.2 

60.0 
60.9 
48.5 
40.6 
5.2.8 



71.0/ 
69.5 
■ 59.0 
50.0 
60.6' 

43.3 

59.4 
.66.1 
47.5 
40.6 
52^ 



Includes- .7. percent vAio were identified as non-English sf^eaking. 
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+1.7 
+ -.6 
+1.0 
+ .7 
+1»8 

+ .1 

- .6 

+5.2 
-1.0 
■ -0- 
-. .3 
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-Table 20 



Survey of Basic Skills Scores for Reading and Mathematics by*Sex 

Grades Six' and Twelve' • ; . 
1975-76 and 1976-77 ^ ^( ^ 



Sex 

y 


. Grade Six 


1^ — 

^Tirade l^lve 


Reading ^ 


Mathematics 


' Reading 


Mathematlca 


75-6 76-7 Difference 


,75-6. 764^ Difference 


"^5-6 176-7^ Difference 


'75-6 76-7 Difference 


State Total 

Boys 

Girls'' 


66.1' 65.9 - .2 
64.?' 64.5 . - .2^ 
67*5 67.2 - .3' ' 


,57.4 57.7 +..3 
57.5, 57.9 " + .4 
51 57.5 + .3' 


64a 1 63.6 ' ; - .5 
64.0 63.4 - .6 

A • 

64.3" 63.8;^ - .5" 


67.0 66.3 - .7, 
• 

69.4 -68.7 -'.7 

64. 63.9 - .8 
• 



Boys ^present 50.5 percent of the students tested in grade six and 49,5 percent of the students tested 
in grade twelve. 1 

. Girls account for 49.5 percent of ' the studeats tested in grade six and 50..5 percent ' of^^he students tested 
in grade twelve. . ' > 
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School-Level and Dis t-Level Analyses of Achievement and Background 

Factd"^, Grades Six and Twelve ^ 

A 

This section contains an analysis of the test results of students- in grades - 
six' and twelve in relation to the background factor data available at the 
school level. In those cases where the same .background characteristic data 
were . also available and analyzed dt the student level, the ^choV)l- level 
analysis complements the previous student- level analysis. 

The reader shoultKbe cautious in interpreting the results from, the ^^alysis in 
this section. Tit is not possible to^determine which background characteristics 
caused test scores to be high or low. Any conclusions made aboilt xiausal rela- 
tionships would be erroneous. 

Summary of ^ndi'ni^s ' . ^ 

1. The schools in the low percentile rankings generally showed a decline in 
scores between 1975-76 and 1976-7^-and those in very high rankings 
showed improvement within the 'same period.. ^ 

2. The schools with the lowest conc^tration of l?ilingi;al students scored 
hi|her than those with the highest concentrations of such oS^tudents. 
General^, the schools with the fewest bilingukl students also made 

^ greatet^chievemeruxgains between 1975-76 and 1976-77 than those with the 
most bilingual students. * \ 

■ ■ . \ ' . • 

3. The schools in large urban areas scored the lowest; those in small and 
^ medium- size communities scored the h ighest. ' * 

4. Relatively large schools tended to score higher than small schools. 

5. ^Jxth-grade stud^ts in elementary school districts scored higher than 
those in unified school districts; twelfth-grade students in hi^ school* 
districts scored Kigher than those in unified -school districts. 

6. Schools with larger percents.of students whose parents were receiving* 
benefits under thp Aid.to Families with Dependent <iiildf^(AFDC) program 
scored lower than those with smaller percents of such ^ pupils. ,Ii> 
general, schools with higgler, -percents of students from AFDC families showed 
a decline in scdres between 1975-76 and 1976-77/ and the schools with 
smaller pefcents of students from AFDC families showed an improvement in 
scores between the same period. 
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138 ^ ^ Student Achievement in California Schools ^ 

Percentile Level Analysis 

Table 21 gives th^ school-* level percentile rankings of reading, written express- 
sion, and mathematics scores for grades six and twelve for 1975-76 and 1976-77. 
From these percentile rankings it is possible to^in-point the clusters of-* 
schools in which the sco^'es declined, remained steady, or increased over a 
period of two- years.. o 

For grade-gix reading, for example, in 1975-76 a raw score of 48.2 corresponded 
to -the 5th percentile school. In 1976-77> a.raw score of 47. 5 'corresponded to 
the 5thA pei;centile , indicating a decline'^of 1 raw sp.ore at this percentile 
point. One can see from Table 21 th^t scores declined for schools in^the lawer 
percentile ranges and remained steady or even Increased slightly for those in 
,the higher percentile categories. The written expression scores dropped ""only 
for the schools in the 5th percentile range; the scores increased for all other 
Schools. The mathematics scores* increased for schools in all percen.tile ranges; 
however, the increases were slightly more pronounced' for higher percentile 
schools. In summary, those schools that are in the 10th percentile or lower, 
showed minimal or no growth and those in the upper percentij.e ranges showed 
accelerated growth. One can safely infer that- the gap between the lowest 
achieving schools and the highest achieving schools increased in 1976-77. 

The percentile ran^ngs for reading in'grade twelye shows* that scores declined 
'for all schools except those in the upper 5 percent category. The percentile 
rankings for written expression and mathematics show that all schools declined 
and tha^ the schools in the lower percentile ranks had*a tendency to decline 
more'. - - 

Tables 23 and '24 give the percentile rankings of the scoi?^s at the district 
^ level. For grade twelve reading, declines bccurred in districts at all jpef- 
centile points except those between the 40th .and 60th percentiles. The written 
expression and mathematics scores increased f6f all ra'ikings, but the greatest 
.increases tended to be in the ♦districts at the Higher percentile rankings. 
For grade twelve the scores dropped in each of the three areas;, the declines 
tended to be greatest in the districts at the lower percentile ranks; 



I 



Percent Bilingual ,4 * 

The percent bilingual figure at the school level was calculated from Jthe inftTr^ 
mation available on -"other language" for each pupil. The percent bilingual is * . 
the percent of stutlents in a school who speak any language- other than English 
and who may or may not spe^k English. Table 25 gives the. breakdown of reacting 
and mathematics scores, percent bilingual. 

In 1976-77, reading scores declined slightly in schools that had 1.3 percent 
or less bl^linguaf students. In schools that l^d 1.4 perce^nt to 11.8 percent 
bilingual students the reading scores increased slightly. There jWas almoist • 
no change in scores in schools that had 26.6 percent or more bilingual students. 
In mathematics, there was a slight increase in scoretfj in all categories of 
schools; . . 
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Subgroup Analysis, Grades Si:^ and Twelve 139 
Location of the Sctioolw ' • 4 • ^ 

Each school in California was placed in one of five categories, on the basis of 
the population of the surrounding coinmunit]^: ''(I) city op 300^000 or mo^e 
population; (2). city o^ 100,000 or more but less thtn>3bO,000 population,^ 
(3) community of 25,000 or more but less th^ 100, OOO' population; (4) community 
of 2,500 or more but less than 25,000 population;, or (5) rural area, .less than 
2^500 population.' The reading*^ and mathemati-cs test scores of schools 
communities are shown in Table 26. 

As, was found in 1975-76, grade-six reading scores were highest for schools in 
location categories (3) and (4), middle size cpramunities'. The schools in 
category (1), very large cities, had the lowest test'scpres. 

\ . 
A comparison of changes from^l975r76\to 1976-77 showed that the^ schools in 
categories of school- -location fol«pi^d the overall statewide trends both in 
grade six and grade twelve. Statlwide increases in sixth-gra<fe mathematics 
scores, for example, are shown as increases in sqores for all categories of 
school' locations. Likewise, statewide decreases in scores are ghown as de- 
creases in scores for all categories of school locations. 

' ' ' ( • * 

size of School - ■> 

— ^ 

s , ' ' ' - 

The number of students tested in a grade was "used as admeasure of school size- 
schools having large numbers -of students %^ted nere considered large schools.! 
Tables 27 and 28 show, the average of school- levfti test scores, "by type of 
district to whldi the schools belonged artff by size of school. Tables 29 and 
30 give the average of district-level test scores for reading and math, by type 
of district aiid by size of district. 

Tables 27 and 28 show t^at the scoresjDf schools in elementary school districts 
exceeded those in unified school districts and; that the scores of schools 'in. 
high sc^^ool districts exceeded those in unified school districts. At the sixth- 
grade level, the test scores were highest for schools in which the number of ' 
#tudents^ tested was between 79 and 101 i^or schools in unified School districts 
and schools in elementary** school -districts. The scores were lowest for schools* 
Tn whrph the nuinber of ^students tested, exceeded 102. #f 

Tables 29^''and 30 givq the results of the district-level analysis. In the . ' 
distric t- level analysis, ^howeve^ the differences between the test scqres^of 
the unifie'd sch6ol districts arj/ those of the elementary school districts or 
between those of the unified^hool districts and^ghose of the high school 
districts were>iot afe shaEjT as those revealed iiithe school-level- analysis. 

The comparison of the ris/ults, across 1975-76 atld 1976-77 at grade six revealed 
that the statewide ^ drop In grade six reading scores resulted primarily from 
declines in the large schools, Especially those in which the number of students 
tested exceeded 102. ^Although there was a statewide Increase in mathematics 
scores in grade six, the scores actually declined in schools in which^^e 
number of students tested exceeded 102. The sixth-grade mathenfatics scores 
increased, however, for the rest of the categories of school size.. 



2'40, Student Achievement* in Calif osnia- Schools ' 

The comparison of sc^iOol-level results across ye ars-e? grade twelve ,(see' Table 
28i) revealed an interesting pattern of growth for ^schools in unified districts-- 
th^ ver^ small, the middle siae anc} the largest schools declined in both^re^^ng 
and math whereas the medium-Small stayed about the same, and the medium- lafg^ 
actually 'improved. No cle^r pattern 'emerged^ for hi gh scj ^ool districts. 

The review of the*^ dis'trict-level results across years at grade six sjio^ d that 
reading scores remained the same* in the elementary school di^str£cts and that ^ 
the scores" in small and medium-size unified districts declined the mo^, • 'Slight 
increases in.mathematic;5 scores were noted in elemeritary districts of all sizes 
and in all unified districts^ except tho^e of medium size (48 to 138 students 
tested), in which the scares declined. The breakdown of the results for high 
school districts indicated that scores increased slightly for small districts 
(1 to 87 students tested) and that scores dropped very slightly in the largest 
high schoal districts. A 'similar breal^down of scores for unified school district 
showei that for reading the declines in scores were spread across all sizes of • 
distriSts; hoOever, the largest declines were in the smallest districts — those 
having 1-Xo 8,7 stud-ents tested. For mathematics at grade tw^lye, the scores ^of 
*all unified districfts decreased, although more so for small districts; The 
trend was revered for high schpol districts, with, the smallest districts gaining 
thfr most. • 



Percent AFDC > » \ 

Data were available at the-school level on tlie 'percent of students whose 
parents were 'recipients of funds from the Aid to Families with Dependent 
Children ^AFDC) program-. The correlation^of the percent AFDC with achieve-, 
ment at both grades six and twelve was mode^^ately high. Tables/3.1 and 32 show 
the test scores of schools, by five categories of percent^'AFDC. The* five » 
categories o°f percent AFDC were constructed so that approximately an equal • 
number of schools fell in each of the five categories. ♦ ^ ' ; 

The exaii^^nation of Tables 31 and 32 showed that test scores y^re highgst in 
the schools or districts with the fewest students from AFDC families. The 
Scores were lowest for scfltfols with a large number of students from AFDC 
families. Tables 31 and 32 are particularly revealing-, when scores are compared- 
across 1975-76 .^nd *! 976-77 for each category of percent A^C. 

Table 31 for grade six reading shows thaf scores remained steady for' school^ 
in'which the percent AFDC was low (8.3 percent or low^r). The reading^ scores 
declined in schools in^\^ich the percent AFDC exceede'd 8.1 percent. 'This means ^ 
that the statewide drop in reading scores'^ at grade six was primarily in the ' 
schools in which the percent AfDC was more ttian 8*3 percent. Similarly, 
Table 31 for grade six mathematics shows that the scores 'increased **f or approx- 
imately one-half of the schools; those f-or which the percent AFDC wa^ below 
the .average;* for the other schools with above average percent AFDC, the s-cores^ 
remaiti^d unchanged. The statewide incr-ease in the overall m04:hem|itics score 
at gra'de six was, therefore, attributable to the increased scores in the 
schools with -the lowest percent; AFDC. ^ > . . ♦ 



Table- 21 



Survey of Basic Skills Scqre by SchpoUPerceiitile R^k' 
' . Grade Six 

. ' 1975-76 and ^1976-77 



School 
Percentile 
Rank 




5 


48.2 • 


■47.5 


. - .7 


,10 


53.0 


52.2 


- .8 


'20 


58.1 


57.9 


' - .2 










, .40 


65.0 


65.0 


-0- 


60 


•69.7 


69.7 


. -0- 


, 80- 


74.4 ^ 


74.6 


■ + .2 








90 ♦ 


77.5 


77.7 


^ + .2 


95 


80.2 - 


80.6 


- .2 


4 









46.1 


45.8 




.3 


.43. J 


43.4 




50.6 


50.1 


+ 


.1 


46.2, 


46.6 . 


+ .4 


' 55.0 


55 . 6 • 




.6 


50.0 


50.6 


~ 


.61.3 


62.2 


+ 




• 55.4 


^55.9 




66.0 


66. a 


+ 


.9 


59.4 


60.2 


'. 8 


< 70.5 


71.7 .• 


. '+1 


2 


64.4 


65.2 


.. + . 8 ' 














73.9 


75.0 . 


.+1. 


1 


68.4 


69. 2 " 


' + .8 


.76.7 


.79.0-" • 


+1. 


3 


71.6 


72.4 


+ .8 • 



Table 22 




Survey of Basic Skills Score by School Percentile Rank 
. Gr^de Twelve ^ 
1975-76 and 1976-77 ' 



School 
Percentile^ 
Rank 



Reading 



1975 



1976-77 Difference 



Written Expression 



1975-76 1976-77 Difference 



Mathematics 



1975-7(5 1976-77 Difference 



5 
10 
20 
40 
60 

80 
90 
95 



52.9 
56.4 
59.4 
62.8 
•65. -2 
67.6 
69-. 4 
71. 1 



52.2 

f 

56.1 
58.8 
62.1 
64:5 
67.1 
^9.2 
70.7 



- .7 

- .3 

- .6 

- .7 

f 

/ .1 

- .5 

- ..2 

- .4 



51.4 
54.5 
57.6 
60.8 
63.2 
65.8 
67.6 
69.7 



50.6 

53.7 
' 57.1 

60.1 

62 

65.6 
. 67.4 
'69.3 




- :,8 

.- .8 

- .5 

- .7 
.8- 
.2 
.2- 
.4 



54.2 
57.8 
61.0 
65.0 
67.5 
'70:6 
11.1 
15.1 



; 53.0 

56.4 
60.2 
64.0 
'67.0 
, 70.-3.- 
72.8 
75.3 



-1.2 
-1.4 

- .8 
-1.0 

- .'5 

- .3 
+ .1 

- .4. 



.ERIC 



School 
Percentile 
Rank 



^ . Table 23 

* 

Survey of Basic Sknis Score by District Percentile Rank • 
, • Grade S.ix 

1975-76 and 1976-77 




' 5 


• 51.4 


50.4 


10 


55.0 


55.1 


20 


59.7 


• 59.7 






40 


65.4 


65.7 


60- 


- 6-9.2 


. 69.4 


80 


73.8 


7 3. .6 


90 


^78.6 " 


. 77.4- 


95 


A 81.3 


80.8 



-1.0 

+ -1 

-0- 
. + .3 
+ .2 
- h 
-1.2 
-A 5 



49.0 
51.9 
■56.0 
■ 61.4 
65.6 
69.8 
7^4.2 
77.7 ' 



49 .\ 



53.2 
57.6 
63.2 
66.8 
71.2 
75.5 
80. 1 



+, .4 
' +i.3 
+1.6 
+1.8 
+1.2 
+1.4 
+1.3 
+2.4 



44:7 

47.4 

50.7 

55.3' 

59.1 

63.5 

68.9 

72.4 



45.9' 

' \ 

48.6 
51.7 
56.2 
5^.9 
64.4 
70.1 
74.5 



+1.2 
+1.2 
+1 #0 
+ '.9 
+ .8 
+ . 



0 



\ 

+2.1 



/ 

V 



153 




Table 24 



Survey of Basic^ Skills Score by District Percentile Rank 
, Grade Twelve 

1975-76 and 1976-77 ^ V 

A - • - i 



3 School 
Percentile 
Rank 



Reading 



1975-76 1976-77 Difference 



-4 



Written Ex pr&^s lon ^ 



19-75-7$ 1976-77 Difference 



Mathematics 



1975-76 1976-77' Difference 



' . 5 

A 1 

20 
40 
60 
80 
90 
.95 



55.8 
57>5 
.60.2 
63. r 
65.1 

* 67.1 
68.9 

, 70.4 



-55:7 
'57.0 

• 

62.3 

/. 64:3 
66.5' 

. 68; 2 
70.'0' 



- .1 

- .5- 

- .7 

- .8' 

- .8 

- .6 

T - . 7 

? 

- .4 



54.2 . 
56.0 J 
58.4 
61.1 
62.8 ■ 
65.3 



53.9 

55.9 

58.1 

60.3* 

61.9 

65.1 



46.9 Si 66.-9 
69.1 68.6 



- .3 

- .1- 

- .3 < 

- v8, 

- .9 

- .2 
-0- 

- .5 



56.7 
59.1 
61.6 
65.0 
67.2 
69. S ' 
71.5 ' 
75.1 



56.1 
59.3 
61.2 
63.8 
66.7 
69.6 
71.1 
73.9 



- .6 
+ .2 

- .4 
-1.2 

- .5 

- .2 

- .4 
-1.2 



IM* « 



0 



.ERIC 



•Table 25 



• Survey of Basic Skills Scores, for Reading and Mathematics by Percentage 

of Bilingual Pupils* in Each School . " 
' Grade Six • 

1975-76 and 1976-77 



Percent 
Bilingual- 

0.0- • 1.3 
1.4- 5,1 
5.2- 11.8 " 
11.9- 26.5 
26. 6-100 . 0 





; Reading 




Mathematics' 


1975-7§ 


1976-77 


Difference 


1975-76 


1976-77 ^ 


/Difference 


71.0 ' 


70.0 


rl.O , 


60.9 


*61.0 


+ .1 . 


69.5 


70.3 




' .60.0 


60.9* 


+ .^9 


68.2 Y 


68.7- 


• 

. + .5 


58.8 


59.9 


41. 1 


65.2 


65:4 ^ 


+ .2 


,56.3 


57.^5 


+1.2 


57.1 


57.2 ' 


+ '.l. 


■ 50.7 


51.8 [* 


+1.1 



'^Solr^tesi? ''^^ '-^^-^ea'^her than EigUsh. and who ^y \„, ■ 



4C 



1^5 




Table 26, , 

Survey of Basic Skills Scores for Reading and Mathematics by' School Location 

Grades' Six and Twelve ' 
^- , ^ 1975-76 and -1976-77 

r 



\ 



^ Population 
of. School 
Area 



Reading 



Grade Six 



75-6 76-7 Diff^reace 



Gr^de Twelve 



75-6 76-7 Difference 



Mathematics 



Grade Six * 



75-6 76-7 Difference 



Grade Twelve 



75-6 76-7 Difference 



^er 306,000 
1(^,000-300,000 
25,«D0-100,000 
2^500-25,000 
Under 2,500 



62.5 62.3/ - .2 



.1 




- .2 



-0- 



♦ » 



60.5 60.1 



63.5 63. 1 .- A 



64.6 64.2 



^3.1 ■ 61.5 



.4 



63.3 63.1 - .2 



-1.6 



54.9 55.4 + .5 

57.7 58". 1 * + .4 

58.2 59.1 +".9 

55.0 38 . 4 +.4 

57.7 5^.2 + .5 



63.3 63.1 

65.8 65.5 

67.1 • 66.7 

65.6 65.4 I - .2 

65.0 §3.8* -1.2 



ERIC 



. \ 



Table 27 

Suyvey of Basic Skills Scores for Reading and Mathematics by Number Tested in Each School 

^ *and by Type, of District 

— Grade Six ^ . - 
- . ^ 1975-76 and 1976-77 



Number 
Tested 


Reading 

■ , ft s. 


Mathematics 


Unified 


Elementary 


Unified. 


9 

Elementary 


75-6 76-7 Difference 


75-6 76-7 -Difference 


75-15 76-7 Difference 


75-6 76-7 Difference 


1-42 

43-61 

62-78 

79-101 

102-409 


66.3 66.2 - .1 
65.7 65.4 - .3 ,/ 

65.4 65.6 + .2 
^6.7 66.2 - .5 
63.7 62.8 - .9 


67.2 67.6 +.4 
67.2 67.6 + .4 • 
67.6 67.5 - .1 
68.5 68.4 - .1 
66.9 66.1 ' - .8 


57. a 58.1 + .3 
56.9 57.3 ~~~-<^4 
56.7 57.4 *+ .7 
57.4 57.9 .. + .5 
55.6 55.3 - .3 


— ^ — ^ — r 

57.9 59.9 +2.0 ] 

58.3 59.5 ' +1.2 
58.2,59.2 -1.0 

59.4 60.0 + .6 
57.8 . 57.3 - .5 



158 



r 



V 



« Table 28 - * 

Survey of Basic Skills Scpres for Reading and Math by Number Tested in School 

y^and by ^ype of District 
g Grade Twelve , ' 

• 1975-76 and 1976-77 



Number 
Tested 


• 

Reading • 


,- - - - — 

^ — - Mathematics 


Unified 


High School , 


/ Unified 
— ^ 


> 

High School . 


75-6 76-7 Differe^cB^ 



75-6 76-7 Difference 


75-6 76-7* Difference 


75-6 76-7 Difference 


1-114 
115-264 
.265-356 
357-469 > 
470-1,038. 


62.0 61.0 -l.t) 
61;8 61.7 - .1 

*■ 

A 

62.4 ' 61.7 - .7 
,63.5 63.9 .'+-.4 
64.3 '*63. 4 - .9 " 


6|,0 62.0 -0- 
62,*5 62.1 - .4 
fsU.U 63.7 ' -.'.7 
65.3 65.2 - .1 
66.2 • 66.8 +. .6 


63.2 62,. 0 -1.2 
63.8 63.7 .- '.1 " 
64.8 63.9 , • - - .9 

66.3 66.5 + .2 

67.4 66.6 - .8 


64,^ 64:8 + .5 
64,5 63.7 - ,8 

* 

66.9 66.3 - .6 
67.8 68.0 +:.2-- 
69.7 70:3 +\$ 

• 



IGO 



\ 



■ ■{ 
IS I 



id 

ERJC 



V 



Number 
Tested 



1-20 



2 1-^/7 
48-138 
139-476 
477-41,933 



V 



< 



fable 29 



Survey' of Basic Skills Scores for Reading and Math by Nmnber Tested in District 

and by Type of District' 
Grade Six • 
• 1975-76' and 1976-77 



Reading 



Unified 



75-6 76-7 Difference 



70.5 65.6 
--h^ — 6-9^ 

66.3 63.7 
, 66.8 67.8 

66.6 66.4 



-4.9 



-2.6 
+1.0 
- .2 



Elementary 



75-6 76-7 Difference 



68.8 67.8 



— 6&^3- 



65.6 65.7 
67.^ 67.6 
67.3 67.1; 



-1.0 



+ .1 
+ .1 
- .2 



Mathematics 



Unified 



75-6 76-7 Difference 



55.5 *58.8 
-58.1 58.1 



57.4 ^5.5 
57:4 58.1* 
5^7^^. 4 57.9 



+3.3 
-p- 

' + .5 



• Elementary 



59.3 61.3 

57.2 5*7.8 

55.9 56.7 

57.-9 58.7 

58.2 58.9 



+2.0 
+ -.6 
+ .8 

+ .7 



162 



16 



Table 30 



/ Survey Basic Skills Scores for Reading and Math by Number Tested >in District 
^ and by Type of District ^ , > 

. Grade. Twelve ' ' * . 

1975-76 and I91f>'ll 



Number 
Tested 



/ Reading 



> Unified * 



75-fe 76-7 Difference 



High School . . ^ 



75-6 76-7 Difference 



Mathematics 



Unified.' 



75-6'^ 76-7 Difference 



^ ^ 

64-8 62.5 ' -2.3 

64.7' (^kyh ^ - ,.3 , 

?.66.3 65.9 - .4 ~ 

• f 

67.4 66,6 - . - .8 ■ 
66:6 66.3. ' - .3 



• High 'School 



75-6 7.6-7 Difference 



1-87 
88-'202 
203-424 " 
.425-897 
898-30,481 ^ 



.62.8 60.4 ,-2.4 " 

63 .-2 6^6 - .6 

63.8 . -'.3, 
64.7. 63.9 - .8 

63.9 63.7 .• - .2 



61.5 63.5 +2.0. 

61.6 61.9 -'+..3 

r 

62.8 61.9 - .9 

.65.7 "65:i. • - .6 

65.2 64.9 - .3 



64.3 66.4 
63.6 . -63.8 
64.6 64.2 
68,1 .67.9 
67 . 9 67.. 8 



+2.1 
+ .2 

- .4 
•- • . 2 

- .1 



4- 



V W 

Jit ' 



\ 



i5S 



■ ' ' Table 31 ■ / , ' 

^ , " , • ' • * 

Survey of Basifc Skills Scores for Reading and Mathematics by Percent 
.^ of Students from Homes Receivinj^ ^ 
Aid to Families with Dependent Children 
' ^ ' ^ Grade. Six^ ' .> 

1975-76 and 1976-77 



Schopl ' 
Pe/Tcent 
AFDQ 


Reading ' 


.Mathematics 


1975-76(* 19.7^77 Difference 


' 1975-76 1976-77 Difference 


. 0.0- 3.8 
3.'9r '8.3 
8.4- 14.2 
14.3- 24 .'3 
24:4-100.0' 


:4%6 73.9 + .3' 
70.1 70.2 , + .1 
67.5 66'.8 • - .7 
63.5 • 62.1 - -1.4" 
55.8 54.9 ~" . - .'^ 

1 't . 


-'64.0 64.8 '* + .8 ' 
60.4 61.0 + .6 - 
57 .> 58.4 * <rf. ..5' 
54.7 54..6 '■- .1— 

' 49.3 49.3 ^%0- 



t 



, Table 3Z • \ 

Survey of Basic Skills' " Scorgs for Reading anS, Mathematics by Percent 
^ \pf' Students from Homes Receiving 
Aid to Families with Dependetft Children . . 

. Grade Twelve • , - 

. y ' \ 1975-76 and '1976-77" . \ > ' 



, School 
Percent y , 
■ AFDC 


*■ " * 

J A Reading 


Mathematics i 


19*75-76 * 1976-77 Diff^nce 


1975-76 Difference 


O.d- 

2.8- 5.4 
5.5- 8.6 
a. 7-15.0 
.I5nn9l.3 


66/6 .. T66.8 ' ' + .2- 
65.4 '64.^ - .7 
• 64.0 - 63.2 ' , ; — .8 
6Z.3 J 61.2 . '^-1.1 
57 .-4 56.2 -l.l 

• r '] ^. . 

7^ T ? ' • 


69.6- 7Q.0' ■+ .4 > 

'68.1 ■ 67.3 • - .8 

66.4 , 65.6 . . - .8 ■ 

64,3 .63.2, - -1.1 

58.8 " 57'. 4 -1.4 ' 
/ ', 

' — ■ — « : : 



VIII. Comparisons with National Noi'ms , ^ * 

Somfe of the difficulties in using publishers' national rfcton^ to judge the » 
adequacy, of the performance of California students are discussed in Chapter 11^ 
Briefly y the two main problems are teck of agreement^ from publisher's sample ^ 
to publisher's sample and lack-of timeliness. Any comparison based on a single 
publisher's norm group (a national sample -of student;s tested at ^ given time) . ^ 
can be quite misleading and is a tenuous undertaking at best. -Since no test \ - 
is given nationwide, one miist rely on vatious publishers' estimates of the 
nationwide distribution of test scores. .These estimates vary from publisher 
to publfsher and are clearly "guesstimates." Part of the problem in establishing 
norms 'is that publishers are dependent upon the |oodwlll and cooper*at;ion of the 
districts they select to administer their tests.* When the districts thai have 
been carefully selected as part of a national sample decline to particiipte in^ 
the normiifg study, the results become that 'much more uncertain^ Also, because 
of the expense involved, publishers are not able to update their liorms more 
than once every five, to eight years. • ^ » , « % 

To cope with this situation, the Department of Educat*ion compares the; perfor- 
mance -of California students with the*norms of a variety of tests and updates 
the comparisons .whenever the* tests are renormed, .or new tests become available. 
This is done by giving a sample of Califyjrnia students both the publishet's 
standardized t^t and the California -test.^ In some cases, no extra JfSsting is 
required. Scores for* a publisher's standardized test are dimply collected from 
school districts which administered that test to all of their students in 
cei;tain schools for other purposft^^ . "Hie statistical* techniques used to equate* j 
the two tests are briefly describe,d^ in Appendix H. The result "of this type 
Of "equating, study" is to show how California students would. Have compared i 
to a natiorial norm group if, in jEact, all CSlifortTiA students had taken the 
published test. \ , ' / % 

This .approach has -several advantages: (X) *the,. national corapa^risons are more 
timely sin^' they can be -updated as new norms become'* available; (2) the esti- 
mates are more stable since they'do not depend:Qn the representativeness of a 
single publisher's stople^; and (3) California students can be assessed with a 
test .that fits the objectiyes of 'the instructional program and simultaneously,^ 
witli almost no additional testing, can be compared to national norms. 

The new comparisons presented in this report are based orh.the tesfc wikh the 
most recent nationals norms available. Several major test batteries are now 
being revised and renortned. Future riports will convey the results o-f studies 
equating the California tests ^ith those tests. This report also presents 
tHe results of earlier equating studies so the^ reader can inspept the long* 
tenrf*(from eight to twelve years) achievement "^st trends in Californfa against 
the backdrop of National notms. ^ 



National Norm Comparisons ^ 153 

Grades Two and Three " ' ^, ' ^ 

• « * * 

Tablfe 33 shows the estimated national percentile ranks of tthe median California 
pupil'since 1965*66. ^^fhe trend over "^the years is clearly one of growth, with* 
the second grade goiag from a percentile rank of 28 to 38 on the Stanford 
Reading Test, from 50 to 53 on 'the Cooperative Primary Reading Test , and now 
from 54 to 55 on the Ccroprehegsive Tests of. Basic Skills . Similarly, third- 
grade performance climbed from the 34th percentile to the 56th percentile. 
Figure 17 provides a pictorial display of these trends. The following para- 
graphs should help the reader, more fully understand^ the national comparisons. 

/ • 
1* The second-grade results for 1965-66 'through 1969-JO and the thifd- . - 
grade results for 1966-67 through 1970-7r were based-on the Stanford * 
Reading Test which was administered to all pupils at thd^e- grade 
levels in California. The norms for the Stanford Reading Test were 
established in 1963. Thus, the gains that occurred each year are 
relative to Uiqse norms. 

2- second-grade results for 1970-71 through J972-73, and the third- ' 

trade results for 1971-72 an*.197.2-73^were based on the Cooperative 
Primarv\ Reading Test (CPRT) , v^ich was administered to'all pupils ' 
*at thope grade levels in California.* The norms for the 'CPRT were 
estaJUlished in 1966r^ The dramatic increase of scores in the 

* ^ . changeovfer years was du€ largely to the great differences between 

the- norms of the Stanford Reading Test and those of the CPRT. ' 

•3. In'1973-,74 the California Assessment Program developed the Reading 
Test. A systematic s^ple'^'of oneJ- ninth- Of , all students tested in 
grades two and three was used in an equating study to estimate 
the performance of the' median pupil in California relative to 
^ 1966 dPRT norms. ^The results indicated little change from those 

of the previous year. ^' ' . ' 

• 4. In .1974-75, the Reading Test was 'revised-arid administered to all 
s^ond-and third grade, pupils in California. The same . jtest Vas used 
in 1975-76 and 1976-77. The results of an equating study, describe^ 
in Appendix H, were, used to estimate the performance of pupil;s in 
California relative to-norms 'establis^ied in 1973 for the Compre - 
hensive T ests of Basic Skills .' Form S". As ^a result of ■ the' modest ' 
increases over the Last two years, the median California pupil <in v 
grades two and three in 1976-77 was at the 55th and 56th percentiles, 
respectively, on the recent norms^ ' ' * . ^ , \ 



Grade Six 



The performance of sixth graders in California declined in the early 1970s 
and leveled cyff in 1974. It has climbed since then. Tdble 34 shows iiwrts the- > 
median California sixth-grade student in 1976-77 was slightly above the national ' 
average (of a sample taken in 1973) .in' reading', mathematics, and language. 
Figure 18 presenta^ diese- trends, graphically. Reading performance, with a 
percentile rank of ^, continued to be slightly higher than l:hat of language 
and mathematics. A^more xiomplete description of these findings .is given below. 
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1. . From 1969-70 to 1973-74 the Comprehensive Tests of Basic Skills (Form 

Q, 1968 norms )^ was administered to* all California sixth-grade students. 
^ During this period the performance of California students declined 
. from four to nine ^percentile ranks on the basis of the 1968 norms ^ 

2. In 1974-75 the first version of the California Assessment Program' 
test, the Survey of Basic Skills , was administered statewide. An" 
equating study that was conducted th^t year showed that scores had 
imprbved and that if the Comprehensive Tests of aasic Skills had been ' 
administered statewide, the percentile ranks would have gone up to 

48^ 43, and 44 for reading, language, and math, respectively.- 

3. A revision of the Survey was administered in 1975-76 and 1976-77- 

An equating study, described in Appendix H, showed that on th.e*basis 
of the 1973 version of the CTBS, California students improved enou^ . 
in 1975-76 .to equal or exceed the national average in reading and 
math. Ip 1976-77 the >Keading score percentile rank remained at 
53, and the improvements in language and math achievement boogted 
^ the percentile rank to 51 for both areas. , . 



Grade Twelve 



The' performance of California twelfth graders declined in 1976-77 to the extent- 
that most of the grogincjL that was gained in 1975-76 .was lost. The performance 
of twelfth graders had declined sharply in 1974-r75. Prio^ to 1974-75 the scores 
had been gradually but steadily declining ^see Table 35^. In 1969 the median ^ 
California twelfth-grade student was scoring at the 52nd^, 42nd, and 48th per- 
centile^ ranks for reading,* language, ahd math, respectively (•on the basis of 
1962 norms). In 1976-77 the median twelfth-grade student was at t]\e 42nd, 
33rd, and 43rd percentile ranks for reading, language, and math, respectively 
(on th^basis of 1962 norms).' California students continued to do most poorly 
in language skilds. ~ 



Figure 19 shows the national* percentile trends, described abqve. The equating 
stuiiy that produced- the Iowa Tests of Educational Development ec[uivalents for 
the Survey o f Basic Skills also compared the California resulClg with two tests 
with more recent norms: the Tes.ts of Academic Progress (1970 norms) and the 

V Sequential Tests of Educational Progress . Se^ries II, (1970 norms). The 
California students compared less favorably '^on these tests, although the pat- 
tern was tlje same: 'language achievement was lowest ) and. mathematics achieve- . 

'ment was. highest • • * . - * ' 
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Table 33 



Grade 



Grade 2 

Grade 3 
Norms: 



National Percentile Ranks of Median Califcprnia Pupil Performance 
s .1965-66" through 1976-77 f 

Grades Two and Three 



Test Administered 



Stanford Reading Test 



1965-66 1966-67 19£7-68 1968-69 1969-70 
28 , " 30 • -32 ■ 36 ^38 

NA*" 34 34 36 ' ^ 36 

Stanford . 1963 Norms. 



Cooperative Primary 
Reading Test 



1970-71 1971-72 197^-7! 
50 53 



38 



52 



53 



52 



Reading 
Test** 



1*973-74 
53^' 



52 



CPRT . 1966 Norms 



Reading Test 
(Revised) 



1974-75 1975-76 1976-77 
54 54 55 



55 



54 
55 



56 



CTBS, 1973 Norms 



3 » 

T3ie new' California test, the Reading Test . Was administered ih •1:973-74 The DercentllP rantQ a-r* k.o.,i ' 
equating of th. MMin^Test Wlhf c^eratlve Primary Re.d,.. T^r ' p.^! ^?;;'';:;^i1."lL";^^^°;l"-°^^ ^" 

. Ble revised Reading Test »as administered to all' California pupilLln 1974-75 • 1975-76 and 1976.77 Th. „.,..„.<.i 

Fom's'^MT' "'"'y the.revlsed Reading ?est and . the C^rehen ye " "islf knir """ 

Form S, which was normed in 1973. ^ 7 ociaic 



Testing ^Id not begfn 441 grade thi*ee until 1967. 
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" — o Stanford Achievement Test ( 1963 no^ms) v - 

* ' ^ * ' ^ Cooperative Primary ReqdingYesi\ 1 966 norms) 

X Reading Test -equ^ie^d to CPRT (1966 norms) ' " 
i , □ Reading Test (Revise*)-equated 4P CTBS (1 973 norms) 

Fig. 17. National percentile ranks of median Califorpia puRil perforAiance, 1^65-66 through 1976-77, V 
grades two and three ^ • 
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Table 34 



National Percentile Ranks of Median California Student Perfonfi^ice 
* • 1969-70 through 191(>-11 * 
\ Grade Six 




1 4 



Test Administered 



Content 
Area , 


Comprehensive Tests of Bas^c Skills 


, Survey 
of 
Biaslc 
Skills^ 


Survey of Basic 
' Skills*' 
(Revised) 


1969-70 1970-71 1971-72 1972-73 1973-74 


1974^75 


1975-76 1976-77 


Reading 

Language 

Mathematics 


— ^ 

48 46 44 U X '4^' 

43 ' 43 ^ 39 ' 39 • ■ 37 

47 43 38 '-38 . "38 


■ 48 

i. 

* * 

44 


53 53 

49 51 

50 51 


Norms: 


eras, 1968 Norms ^ > 


CTBS* 1973 Norms 



The new California test, ^the Survey of Basic Skills; Grade Six , was administered ' 
to all CalifQifnia pupils in 1974-75. The percentile ranks are based on an equating 
o^l^e Survey of Basic Skills and the Comprehensive Tests of Basic Skills (CTBS), 
Forte Q, tWitph^w^s normed in 1968. ^ 

The revised version of the Stirvey o^ Basic Skills: Grade Six was administered in 
' .^^^^r^^ 1976r77. The percentile ranks ar^ based on an equating of the revised 
" Survey of Basic Skills and the Compraiiensive Testg^ of Basic Skills (CTBS), ^Form S, 
1973 edition,' the test for which the most recent norms were available.' 
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Key: I 

o Qomprehensive Tests of Basic Skills (\ 968 norms) 
□ Comprehensive Tests of Basic Skills (1973 norms) 



Fig. 18. National percentile ranks of median Calif<kmia pupil performance, 1769-70 



through 1976-77, grade six 
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Table 35 . ^ . • ' 

National Percentile Ranks of Median California Student Performance 

1969-70 through '1976-77 . . ' 

- • Grade Twelve ^ 




' The new California test,' the-Survev of Baalr <?kmn. r^,^-, tv i , - 

California students fro^ 197 4- ybthr^Lh teft 7? r^S ^^l"^^ administered "to all 
studies of. the SurveT^' Basl^ P9:centile ranks are based -on equating 

Tests Of Educat..n./n;i?:!fLf^I!l -^ ^^f^Tl^'^^^tj^^^^'^ ^ 



Tests Of Educat.nn./n::.r:::L:"';:i T Nomediriglf ^Lt^^'or:' ^ 

nnrmed ^n>^Q7^. nr,^ — x^wii ^, nunaea in i^Oii, Tests of Ac adeinlc Progress . «^ 

.normed ln/l970..and (3) Sequential Tests of Bducatinn.T P..^ .. .. c...^ ■ „^,„;;;^ [;;"^-^ ^ 
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o Io\s^a Tests of Educational Development i\962 norms) 

□ Sequential Tesfs of Educational Progress, Series II ( 1 970 norms) 



A* Tests of Academic Progress ( 1 970 norms) 



0 ^ 



Fig/19. Natioi^alpercentUeranksof nKdian California pupUperforniance, 1969-70 
' thrpugh 1976-77, grade 12 / , 
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APPENDIX A 



Reading Performance, by ^iU Area, of Catifornia Second- and' < 
Ihlrd-Grade^ Pupils, 1974-75, 1975.'76, and 1976-77 



Ski^Bl area 




■ Average percent of questions answered corre^ctly 



Ko. of 
Items* 



1 Grade two 


5^" . 

'Grade d^ree 


1 1974-5 


i97y^ 


1916^1 


1974-5 ' 


1975-6 


,-1976-7 
















C67 7"^ 




vol . , 


vol . U,) 


V91. 1) 


_ % 








y 


(75.4) 


(75.5) 


(76.2) 


(85. 8X 
• 


(85.6) 


(85.9/ 


83.9' 




*85.4 




92.6 


* 

92.9 ^ 


• 














• 










■ 




f 




















(76.5) 


(76.5) 


(77.1)' 


(86. X) . 


(85.9) 


(86.2) 














73.9^ 


73.9. 


74.8 


84. 5 


83.8 


84.2 


f 




















"/ 








r 
































^80.3 


80.3 


81.0 


87.8 • 


88. r 


88.2 






















• 












V 


• 












r 






















.^72. 9 


12.1 '-i 


72:8 

* 


84 J" 


84.9 


85,1 















Illustrative test question 



TOTAL READING TEST 



I, vJbRD IDENTIFICATION 



A. Sight words 



B. Ftionetlc'^^na Lysis 
* - * " 

1. Consonants'' ^ 



2. 'v<Xels 



3. Spelling 
patterns 



(Tdtal and averages for word 
'identlfflca'tlon skill areas) 

the ^uftSl-Aust choose the. wQ^d 
that names the bbject which Is 
pictured. ^ 



<Total and averages for phonetic 
analysis skill- area, a subcate^ 
gory of word. Identlf Icatrion) 

The pup.ll must choAe the wor<l^ 
that has a Letter 'that Is not 
3 sou^vded. 



the ^^pil must choose >the 
printed word that has the same 
vowe^ sound as Che oral stimulus 
word. 



The> pupil must cho^e the ^ 
^r^nted wofd that rhymes with ^ * 
the ox^al stiisulus word. 



(250) 
(60) ^ 



(^5) 



15 



20 



10 



Teacher" says: '"Mark the word that goes 
bes.t with the Rlcture." ' ^ ' 



o Spool 
o spoon 
0 'stooL 



Teacher says: •'Mark the .word, that fias 
a letter that Is not sounded." 

. o right 
^ , o lift 

^ o spent 



Teacher says:* '>1arj<; the word that h'^as 
the same vowel SQund In Its middle* as 
the vowel sound in the word run . *^ 

\ ' ' ■ ■ 

^ o out 

o ran , 'p, 
Q fin - 



« Teacher dajts: J^'Mark the wprd that 
rhymes with the underlined word;" 



s^ow 

T 



2 The only values presented in this colunn are averages . The percentages fpr Indl-^ldual Items varled^from 
these sample test Items are presentctf for Illustrative purposes only; therefore, they do not cover all of 
possess all the qualities of good test Items. " , ' . . 



o' bJ.ow 
o down 
Q cqw ' 

the average value by 20 or taore po'lnt^. 
the Skills tesCed , nor do 'they necessarily 



Sklfl 



C. Structurai 
analysis 



It. VOCABULARY *' 



A. Denotation 



ERIC 



B. Relational 



l\ Synonyms 



2. Antonyms 



3: Hoaonyms ^ 



Assess 



Description of^ skills assessed 

The-pupll must Identify roftt" 
words, suffix^, <r6mpoun<f words, 
^and contractions. 



(Tot^l and averages fcff voca-* 
bulary skill areas)' • 

The pupil must choose the 
response word that best fills 
t*he blank In the sentence. 



(Total and avenag.es* for rela- 
tional skill arAas, a sub-' 
category yocatuTary) 

The pupil musjr^choose the' re- 
sponse word/that means ,the same 
as the^j^under lined word In the 
phrase? 



The pupil must choose the 
spofins^ wQrd t^at means the 
oppositeVfc the printed 
sthnulus word. 



re- \ ♦ 



Alt^ugh the format-iot^ this test 
Item Is «the same as that* used for 
denotation, the pupl^l must choos# 
the response word from 4aong 
three paving ^he same sound. 



No^ of 
Items 



Average percent of questions answered correctly^ 



, Grade ^two 



1974-5 



»65.8 



(60) 



22 



(38) 



24 



(67.7) 
68.8 



(67.0) 



67.6 



10. 



65.7 



. 4 



66.5 



1975-6 



6^.3 



(67.6) 
68.9 



(66.8) 



67.0 



65,7 



67.2 



1976-7 



67.5 



(68.6) 
69,6 



Grade three 



1974-5 



80.9 



(82.6) 
84.0 



(68.0) 



68.3 



(8K3) 



83.2 



67.^ 



6^.6 



■■I 



78.4 



82.4 



1975^6 



80.8 



(82.9) 
83.6 



(82.5) 



83.5 



80.4 



81,5 



1976-7 



81.1 



Illustrative test question^ 



Teacher sa.ysfsV'Mark 



sfs^Mi 

^ TV . 



mblnatlon of 



(83.4) 



84.6 



(82.7) 



83.9 



letters that 1> the correfct division 
"l-^of the undejrli^ed wptx^Jy 

f Irehouse o f L + rehouse 
^ ' o fire + house- 

o flreh +'ouse 



Tea^^hyjFs^ysr "Mark the word that goes 
In th^ blank 'In the sentence." • 

.Father told Pat to the b^ck 

door., 

. o ^eave o ' , ^ 
o fast 
. * -o close . 



Teacher says: "Mark the word that means 
the same as the word that Is underlined.' 



a smal 1 dog 



cute 
o little 
o happy 
o funny 



80,1 I Ttjachftr says: "Mark the. viord that means 
the opposite of the* underllnetl word.^ 



81.9 



llRht 



'-\o evening 
o dark N * '» 
o^ bright 



Teafher says: "Mijrk t^e word that goes 
l^n the blaftk In the sentenct." 



We have 



dogs. J t 



to 
o too 
o two 



181 



Skill area * 
4 



IIlT COMPREHflNSION 



Liberal 



\ 



B. ♦Interpretive *' 



IV. sWy-logati^nal 

• * SKILLS 

A. Alphabet iziiig 



IS 



CO 



Description of skills assessed 



(Total and ayeragies foj compre- 
hension skilKareas)* V,, 

Civen a. passage of printed, * 
material, the pupil mus.t choosey 
the correct C;esponse tor a «;rlt€$^ 
question that requires* identi- ' 
fying or remerabVring elemen^f 
the fjassage which' were explicitly 
stated. ' / ' ♦ 



CUO) 
10^ 77 



G'iveh a passage of print'Cd 
material, the «pupil mu^t choose 
the coc^ect resp<5ps« to a written 
question th^t requires using 
ideas and information, explicitly 
stated, to par.aphrase, infer ftom 
relate, or generalize from ej.e- 
ments in tjie passage. ' < , 

^ ' ■* • . 

(Ttfta^ and* averages for study- 
loc^tional skill' areas) 

The ipupll must ch«osf which 
letter or word, comes first' in 
aIphabetical'.order.« * 



No. of . 
Items 



Average percent*^f questions answered correct?ly^j 



Grade two 



Grade three'' 



(61.3) 



33 



(20) 



10 



58.7 



(75.5), 

,73.8' 
f 



(61.3) 



62,3 
N 



59.1 



(^77.2) 



75.5 



1974-5. ,1975-6; .1976f7 l|^-5 1975-6 



Illustrative test question^ 



(62.4) 



63.4 



(77,0) 



77.9 



) 

60.0 



74.5" 



(77:9) 1(88.0) 



76.3 



87.8 



(76.7) 
77.5 



74.9 



(88.0) 
87.3 



1976-7 



(77,1) 



78.0 I Dear Children, 



I hope that you are having a good 
time and w6tking hard^ I have missed 
the whole class very much. Miss' Smith 
has been telling me that you have been 
very helpfd'l to her. 

Thank you* for all your cards an'd 
flowers. I h^ve even had \a few sur- 
prise visits* from some of you I 

V I hope to be back as your teacher, 
soon. Un^il then, your get well cards 
made me think of you. ^ 



Your teacher 
^Mts. Black 



What have the chil 



sent Mrs. Black? 



o cards aryj telephone calls ^ 
o c^rds an<J flowery 
flowers and' clofhes 



f(^d, and cl-Jth'es 
7 5.j0 rwhere-^has Mrs, Black been? 



(88,8) 

No 

87.9 > 



o on a, trip 

o teaching in another class 
o sick , / 

o visiting out* of town. 



/ 



Teacher says; '*Mark\he word that coi^s 
ftrst In alphabetical\ABC) ^order.' 

^ o dent 
o drive 
. o dart 

o dog 




Skill area 




/• * B. Table of contents 
ft 



er|c 



184 



Given a table of 
page number, the 
choose the story 
the given page. 



contents and a ' 
pupil must 
that begin^on ' 



-4 



/ 




Average percent of \ue8tk)ns ansioerelT correctly^l 



No. of 
Items* 



drade 



Grade three 



Illustrative test question.. 



1974-5 1975-6 1976-7 D 1^74-5 1975-6 



10 



77.3 



7^.0 



79.6 



88.^ 



88.8 



1976-7 



89.7 



\ 



Teacher says:. "A page number is* under- 
lined. Look at the table 'of contents 
and ^hen-mark the title. of the story 
that begins ©n t;he page that Is under- 
lined. " 



TABLE OF CONTENTS 




The Happy Puppy . . . 


6 


John's Pet Frog . . . 


12 


The Little Horse . . 


19 




28 


'rte Lost Turtle . . . 
' r- 


32 



Page 19 o The Happy Puppy^ 
o John' s Pet Frog 
o Ih^ Little Hotrse 
o Moles ^ 



r. 



185 




APPENDIX B 



Reading Performince, by Slclil Are*, of CallfornU Slxth-Grmde Pupils 
for I^TPT^ and 1976- 




•Skill area 



Description o>f skills assessed 



TOTAL READING TEST 



WORDflDENTIFICATION ^ 



II. VOCABULARY 



III. COMPREHENSION 
i 

A. Literal 



^The pupil must Identify correclgpronun- 
elation of words used j.n context , raot 
Vords , tfie meaning of a*f f Ixts, and cdi^- 
tractions, ' ' ' 



The pupil Diust Identify the meaning of a 
specific word In context. 



Skills asseMe^'ln categories A and B. 

fhe^jmpll must Identify or remember 
' elenients which have been**expilcltly . 
s^at^d. These eljbeifts Include main 
Ideas, details, ahd cause-and effect 
• relationship^. 



:1 



No. of 
Items 



(128) 



18 



25 



39 



i 



Average percent/ dT questions 



.answered correctly 



1975-6 



(66.1) 
74.3 



67.1 



(64.9) 



67^ 



1976-7 



(65. 
74. 



9) 



66.3 



(^.9)- 




The valuea*preaented In tf\it 'column are averages of the perceflts, of que»tlona antwered correctly. 
the average value'by„20 or:, more points . • * ^ * \, ' ' < ' 

I* T B$mpU test I'tema are presented for lUuttratlve purposes only; therefore, they do no* cover 

■ A J-' poMf all the qualities bf good test Items. ^ » - 

,ERIC J , *. «■ 



Change 



(-0.2) 
-0.1 



-0.8 



(-t)-) 



-0.2 



Illustrative' test question^ 



Xhe ^d 



0 . ^ * 

idlng of the worB tall est makes the 
word mean: » ~ 



> o as t&ll as 
o less^pill 

o taller than 
o most tall 



The boys made a hasty declslon^to go'. 
camping over the weekend. 

^The word "haaty" as used here means?*** 

o hurried 
o wrong 
o thoughtful 
o hard 



Traveler^ say our roads -would be safer 
If we changed present road signs to 
picture symbols, or ^ymphs. With these 
picture signs It Is not necessary for 
travelers ta learn the language of a 
country to im4er stand the directions'. No 
words are/jsed on the signs. Tt^se who 
favor u^ng glymphs In the United States 
admit that drivers «would have to learn 
the picture syi^bols first. # 

A glymph Is a; 

o traveler 
' o road 

o picture 
• • io^ord 



percentage: 



• ■ I 

8 for individual 1 



terns may vary from 



The 

all of i\h skills tested, nor do they ,Txeces8artly 



is;? 




Skill area 



J 



B. Interpretive/Critical 



IV. STUDY-ipCATipNAL 



4 I 



Descriprtlon of^skills assessed 



Ihe p&pil iDust use ideas and informstlon 
explicitly stated to iofer from, relate, 
or generalize from elements in the 
materials read. These elements include 
main i4eas, det^^alls, cause-and-effect, ' 
and author' r purpose. 

rte pupil must identify vhich reference 
book to consult And be able to use parts 
of a \)ook such as an in<j£x and table of 
contents. ^ ^ 



■ f 



ERIC 



1S8 



/ 



Average percent of questions 
^answered correctly^ 



1975-6 



1976-7 



Change 



Illustrative test/questiort^ 



61.8 



60.0 



62.0 



59.8 



•+0.2 ^ 



f. 



-0.2 



Gly^aphs will probably help * 

o prevent .acciderits'^ 
• o tlie blind ^ ^ 

^o fou learS^to read ' . 
o you learn other languages 

' k 

If you wante<J -fo know the meaning of the 
word candid , the l)e/t book to use would 
be: . 



o a dictionary 
o an 'encyclopedia 
o an atlas ^ 
o the card catalog 




/ 
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APPENDIX C 



Reading Performance, by Skill Area, of Cal 
^ : ^ for 197 5-76 and 



lifornia Twelfth-Grade Students ( ^ 
1976-77 , , \ 



Skill area 



I. VOC^ULAKY 




Description o^ skills assessed. 
7> X ^ * 



READINO'lEST 



< 



'II. COMPREHENSION 
X^. Literal 



B. Interprett^e/Critical 



y ■ 



III. STUDY-l^mOKAL ^ ^X:^ 



Student must identify the tfteaning of 
pecific word in context;^ given/ a 
definition, the stu^nt will select from 
a list the word most, nearly opposite in' 
meaning. ' >- 



(Skills as^t&sse^ in categories A and B) 

From a paragraph or passa^, the student 
must identify or remember elements which 
have been explicitly stated. These 
elements Include mail) ideas, details, 
sequence, and cause-^nd-ef fept relation- 
ships. ' . • ' 



From a paragraph or passage, the stufirtsnt 
must use ideas And information expMHtly 
stated to paraphr4.se, infer frorn^ relate, 
or generalize f«<^ elements. .Jliese 
elj^epts- include-main i4&^>, de"t:&il^»^ 
cause-atTd-ef f ect , and author *-s purpose* 



Jhe student 15ust id|fctify whi^J^p^eferenc^ 
book t^o^onsult and oe tible to*ti$e parts 
of a bookj^such as an index and table of 
contents, '^'o 



N9. of 
Items 



(141) 
31 



I 

(97) 
47 



5^ 



Average percent of questions 
answered correctly^ 



1975-6. 



(64.1) 
61.3 



(64.J) 
6*9,2 



60.1 



13 



68.4 



1976-7 



(63.6) 
60*. -9 ( 



(63.9) 
68.9 



59.3 



67,2 



Change 



(-0.5) 

■■»■', 

(-0.6)^' 
-0.3 



^1.2 



Illustrative test question^ 



.^The word "pe«rs^' in the last sentence 
^ means: * 

o Qthej congressmen ^ 

<5 the voters 

o Sp6aker^ of the House 

o committee chairmen 



ihe current reform described in the,se 
paragraph's was begun i>y: 

o. R^publijcan Congressmen 
o Democratic Congressmen 
o "Uncle Joe" Cannon 
o ;p6mocratic Senators ^ 



In the future, committee chairmen uiH 
prob'ably ^ * 

>o^pt for a cleaner system, 
o, have,t;p ^e more responsible. ^ ^ 

o be selected by '*Uncle Joe." 
o Examine* the effects of tfje earthquake.' 



To discover last year's Gross National 
Product tax the United *States , you* .« 
should consult: ^ ^ * 

o a dictionary^. 
' . o a ^thesaurus 

\ 6" an almanac J. 
' 0 an encyclopedia 



The values presented* io this column ar.e averages of ^he percenCs of qu^sttofts answered correctly. The percentages for individual , items may v^ry from 
'2 the averagi'^value by 20 or more* points, , , / -o' . 

, These sample test items are -pr-esented for iltufetrative purposes only; therefore, they do not cover all of the skills tested, nor do they necessarily 
possess all the» qualities 'of go'o<^ test items, ^ ^ ' . * . * , , ' , 
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APPENDIX D 

Written Expression «nd Spelling Pe^fonwnce, by Skill Area, 
of Callfomlft Sixth-Grade Pupils for 1975-76 and 1976-77 



SklU area 



Description of skills assessed 



TOTAL WRITTEN EXPRESSION TEST 



WORD FORMS (see Morphology, 
Test Content Specifications) 



II 



STANDARD USAG^ >^ 



NO 



III. 



ti^NGUAGE CHOICES 

i 



IV., SENTENCE RECOGNITION 



The pupil misi select the appropriate 
suffix (-e^, -Ing, -s, -ly, -er, -est, 
's) for a word In a given sentence. 



Th^ pupil. must select the verb or pronoun 
Infa sentence? wljlch reflects 'standard 
English usage. 



The pupil must select the most vivid 
verb or specif Ic noun for a given 
sentence. 



The pupil must recDgnlze complete 
sentences, fragments, run-ons, and normal 
Engjlsh word order In sentences. 



No. of 
Items 



(128) 



16 



16 



26 



22 



Average percent of questions 
apswwed correctly^ 



1^75-6 



(6.2.5) 



82.4 



75.3 



5A.4 



1976-7 



62.3 



(63.6) 



82.3 



75.3 



56.5 



63.0 



ERJC 



\ The valuaa pre««atad In thla column are averagea of the percenta of queatlona answered correctly 
the average value by 20 or more polnta.* * ' 

^ Theae aaaple teat itcna are preaented for llluatratlve purposea only; therefore, they do not covei: 
possess all the qualities of good test Items.' 



Change 



(+1.1) 



-0.1 



-0- 



+2.1 



+0.7 



Illustrative test question^ 



Fill In the oval next to**the word that 
besy fits each sentence. 

The children were still in the 

pool . 

o play 
o plays 

o playlhg • 
o had jJlayed 

Fill in the oval next to the word that 
best fits each sentence. 



Leroy 



the movie yesterday. 



o saw 
o seen 



Pretend that you are writing a story. 
Fill In the oval next to the word that 
will give your reader the beat picture 
of what's happening. 



The snake 



. across the ^rass. 



' .o moved 
o slithered 
o w^nt 



Fill In the oval next 'to the group of 
words which needs more to jnake It a 
complete sentence. t 

bought a house, 
o She Is hungry. 

o {»edro Is not there. • ' 

o In the heat of the day. 



The percentages for Individual ltem/%ay Vary from 
all of the skills tested, nor do they necessarily 



192 



193 



i 



Skill* area 



• Description of skills asse^ssed 



V. SENTENCE MANIPULATION^ 



VI. CAPITALIZATION 



VII. PUNCTUATION 



o 



VIII. 'SPELLING 

A. ^latlonshlps 



Tl^e pupil^must select the most effective 
sentence or sentence element. 



\ 



1 




\- 



The pupil must, recognize >«<2rds in'^ 
sentence which should be ca^rt-tarlized , 
such as the beginning word of a sentente, 
names of persons and places^ days of the 
week, and months of the year. 



- ) 

The pupil must identify errors in the use 
of the period, question mark, exclamation 
point, conina,* apostrophe, and quotation 
ma rks . * 



From a list of* 3 or 4 words, the pupil 
must identify the incort?'ect spelling 
relationship for vowel and consonant 
sounds* 

^ -6 . 



Average percent of questions 
answered correctly 



1975-6 1976-7 Change 



Illustrative test question 



61.7 



62.6 



■K).9 



57.4 



58.4 



52,4 



52.5 



(63.6) 
58,1 . 



(63.6) 
58. 1 



-^r.o, 



-K).l 



-0- 



The following sentences say the aiime 
thing differently. Fill in the oval^ 
next to the best sentence. " 

o ^ brother went and broke the new 
clock. ' 

o The new clock was broken by my 
brother*. 

o The new clock was broken because of 

ray brother. # 
p My brother broke' the new clock. 

Fill in the oval next to the linfe with 
the mi^stake in capitalization. If there 
is no mistake, fill in the fourth oval. 

o In^ social studies we are 

-o learning 9bout many countries. 

o ray favorite is Israel. 

o (No mistakes) ^ 

Look at the underlined portion to 'see if 
there is an error. If you find an error 
in punctuation, fill in the oval next to 
the letter of that^ error. If there"* is 
no error, the answer is- D. 
* 

"I dont mean to refuse the doctor' s 

A . "B . 

advice, but I still believe that sunshine 

is the best cure for a col d," said Aunt^ 

' C 

^Olive. • No error . 

D 



o A 



b B 



o C 



o V 



Fill in the oval next to the misspelled 
word in each group. If th^re is no mis-* 
spelled word, the answer is "all correct." 

o steam 
o bcreem 
o sleeve 
o All correct 



■J 



ERIC 



SkfU area 


1)escripCion of skills assessed 


No. of 


— f ■ _ 

Average percent of questlgns 
answered correctly^ 




Items 


1975-6 


^ 1976-7 


Change ' 


Illustrative test question^ 


B, Word Forming 


' * 

The pupil must select the correet spelling 
pattern used In a variety of comnon word 
formations.. 


29 


70.2 

t 


70.3 


+0.1 . 


Pairs of words are given below. In each 
pair, one word Is spelled Incorrectly, 
Fill ln» the oval next to the correct 
spelling. • * 


• - \ 


9 


€ 

i 

TV 




• 




y 0 steped , 

o#stepped ^ ' 

1 

/ 


1 


f * 

J 
\ 

% 




, ' 4 








N 














s 








/. 


• 


• 




— 


r 


- 








/ 










- 
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f 




9 
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APPENDIX E 



•Written Expres*slon and Spell Ing "Performance , 



by Skill Area, of California Twelfth-Grade Students 
•76 and 1976-77 



Skill area 



Description of, skills assessed 



No. of 
Items 



Average percent o€ questions 
'answered cotrectly 



1975-6 



1976-7 



Change 



Illustrative test question 



TOTAL WRITTEN EXPRESSION TEST 



WORD FORMS (see' Morphology, 
Tdst Content Specifica- 
tions) 



II. LANGUAGE CHOICES 



*III. SENTENCE RECOGNITION 



IV. SENTENCE MANIPULATION 



The student must select Jthe appropriate 
Inflectional s^ifflx (-ed, -Ing, -s, -ly,^ 
-er^ -est) for a given sentence, must 

^discriminate between form class words 
(such as nouns and verbs) and structure 
words (such as prepos Itlons) , . and must 
demonstrate dictionary skills for a , 

'Variety of purposes. 

The student must identify attitude- 
conveying words and phrases, must dif- 
fc^ferentlate between specific and general 
sets'of words, and must identify the 
audience of a/ prose passage. 



The. stu^djent must recognize cortiplete 
sentences,^ sentence parts, sentence 
patterns, and appropriate subject-verb 
relationships. * 



The student must select the most economi- 
cal,, effective sentence and must be able 
to recognize effective coordination *and 
subordination within sente^nces. 



>42) 
24^ 



32 



20 



12 



(62.3) 
72.6 



66.9 



67.3 



42,9 



(61.9) 
'72. 1 



66.7 



67.7 



42.9 



(-0.4) 
-0.5 



The. dogs had 



40.4^ 



4- 



the long trek. 



o survival 
o survivors 
o surviving 
o survived 



Which of the following is most specific? 
o plant 

o redwood ' 

o tree • ' 



o llvlag thlng^ 



Identify the 'group of words *which is 
incomplete or needs ^addltloi^l words .to 
compJ.ete the <neaning. 

t 

o Mack and Sonny skipped school, 
o The rising clouds of dust, 
o The day was hot and clear, 
o Ipjplve o'clock is lunchtime. 



Mark the sentence below which e:{pr^sses 
the thought most EFFECTIVELY aftd 
ECONOMICALLY.' 

o -He spoke to me ^n a very warm manner 
- yhen we met each other Tuesday, 
o When we met Tuesday, I w^s spoken to 

in a. very w^rm manner by him. 
o His manner ,was very warm when meeting 

and speaking to me Tuesday., 
o Tuesday 'he greeted me warmly, 



The Jiralues presented In this colXimn are averages of the percents of quest^ns answered correctly. The percentages for litdlvldual items may vary 
from the average value by '20 or more points. * 
^ These sample test items. are presented for illustrative purposes only; therefore, they (Jo. not cover all of the sklLds tested, nor do they necessarily 
possess all the qualities of good test items. ' * . >^ * v 



X Skill area . 



V. PARAGRAPHS 



VI. CAPITALIZATION AND 
PUNCTUATION 



VII. SPELLING 



200 



ERIC 



Description of skills assessed 



The student must identify irrelevant 
material in a paragraph, recognize incon- 
sistent time development, select the 
logical sequence of a group of sentences, 
select the sentence which best summarizes 
.the ideas presented in one or 'more re- 
lated parapraphs, and identify transi- 
tional elements within a paragraph. 

' t 

The student must recognize capitalization 
and/or punctuation errors ift sentences. 



The student ^ust decide if an underlined 
word in a given sentence is spelled 
correctly. 



Average percent of questions 
answered correcttly*^ 



No. of 
Items 



1975-6 



1976-7 



Change 



Illustrative<*test question^ 



26 



59.9 



59.1 



28 



54.6 



54.3 



72 



68.0 



66.8 



-0.8 



-0.3 



Which of the following phrases is used 
to indicate a connection ^between the 
two (given) paragraphs? 

o Could not know 
o Even so 
„ o They lead 
' o They shape 



Identify any capitalization of punctu- 
ation errors in the underlined parts 
of the following sentence, 

n 

The HillSj^ who have juSt returned ' 
A 

•from Uke Tahoe, are already planning 
B 

next^inte r' s trip. * No error . 
C D 



o A 



o B 



o C 



o D 



Fill in the oval next to "right" if 
the word is spelled correctly or next 
to "wrong" if the word is spelled' 
incorrectly. 

Carmen steped on my toes. 

o right ^ 
o wrong 
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^ APPENDIX F 

Mathematics Per formancfo, by 'Skill Area, , of California Sixth-Gr^de Pi 
for 1975-76 and 1976-77 V ' 





Skill area 
1 



Dtbcription of t>kills assessed 



No. of 

Items 



Average percent 

, answer ed g^rrectly 



197 5-6 



/ 1976-7 



Change 



Illustrative tesf 



TOTAL MATOEMATICS TESli — 



I. ARITHMETIC 



A. Number concepts 

1.,' Number and numeration 



2. Number theory 



3. Number properties 



(Skills assessed in categories A,^ B,, C, 
and D in I. Arithmetic) 

(Skills assessed in categories I , 2 , apd 
3 in A^r^^umber conciepts) 

The pupil must identify whole number-s,> 
fractions, and decfmals , identif v place 
value; and recognize pointe on a number 
line. ' ' 



The pupil must recognize odd,^ even, 
prime,^ and composite numbers and choOse 
the lowest common multiple or greatest 
common - factor of several numbers/ 



The pupil must r^eco^nize commutative,^ 
associative,^ and distributive properties 
of operations on numbers.' 



(160) 
(96) 

(28), 

13'^ 



(57.4) 
(61.0)' 

(65.4) 

75.^^ 



56.1 



58.6' 



(57.7) 
(61.0^ 

(6i.5) 

> 

75.6 



(+0.3) 
(-P-) 

^OO.IX . 

+0.6 ' 



36.1 



-0- 



What digit IS in the tens' pl^ce an 
4,263'^ ' \ ' 

^ " 0-2 ' . 

. o 3 s . ^ * 

o 4 • 

o 6 

o None Qf these 



What is the greatest. common divisor of 
8, 12, and l^'' 



o 4 
o'8 
o 12 
b 10 



57. S 



-0.8 



Name the missing^, numjberi 
6 X 15 X 6^ • ^ 



o 9 ' 
o 15 

o 90 ^ ' 

o 54a 

o None 'of these 



^ The values presented in this column atf' averages <5f the percenfa of' questions answered correctly. The percentages for iodividual items ma^vary from 
the Average v^lue by 2Cr or more. points. j . ^ ^ . \ , ' 

^ These sample test items ar^ pregerHed for illustrative purpbses only,; therefore, ttiey do not cover all of the skills tested, ^ox do they 'necesS^yil y 
possess all the qualities of good test items. ^ . * 



Sktll ar«a 



B Whole numbers* 

1. Computation 

2. :^jflplication'^ 
C. Fractions ^ 



.1. C^irtRtftation 



2. Application 



'D. ^^^i 



imals 



1, Comput-ation 



204 



De^rip^ion of "skills asse>»sed 



^ (Skills assessed in cart^gQries b-and 2 
-in-B. -Whole numbers). i ^ 

TOe pupil must 'perform addition, sub- 
•iraction^ multiplication, and division 
.Involving wbolV numbers, 



pupil must' apply the 'four arithmetic 
operations o'n whole numbe-rs , solv ing ) 
problems presented in a.dail^ life' 
conj:ext . 



(Skilly assessed in categories T and 2 
in C. Fractions) 

The- pupil must perform addition, sub- 
traction, multiplication, and ^ivision 
•involving fractional numbers. 



The pupil must usp fhe four arithmetic 
operations on fractions, mi>^d numbers, 
and fra(;tions to demonstrai^ comprehen- 
sion or ability to solve /roblems in a* 
daily life context. 



(Skills asse'ssed in categories 1 and 2 
in D. Decimals) 

The pupil must perf orm .addit ioQ , sub- 
traction, mulxiplicatio^,'- ^d division 
ir^volvin^ decimal numbers. 



ERIC- 



No, of 
Items' ' 



Average percent of t^juestions 
i answered corgectly^ 



1975-^ 



19.76-7 



Change 



Illustrative test' question^ 



(28) 



^(66.9) 



(67.5) 



(40.6) 



16 



12 



/7.A 



32.9 , 



53.6 



(20^ 



13 



(A9.6) 
' 50.5 



•48.0 



(A9.0) 



A9.8 



/^7.5 



(20)^ 



12' 



(56.3) 



56.6 



(5>.8) 



58.9 



40.5 



+0.7 



(-0.6) 



-0. 7 



-0. 5 



(41.5) 

i * • 

+2.3 



6003 
-209 



o 6,79A 
o 5,89A 
o 5,80A 
o •5,79A',* 



Joe packs tomatoes to a box. If he 

has packed, 18 tomatoes, wl^lch Box is he 
now packing? 

♦ o the fourth 

o Che fifth 

o the sixth , 

o the eighteenth 



A X A/7 = o 1 2/7 
o 2 2/7 
o A A/? 
o 7 



Jack's spelling test had 60 words. * He 
spelled 3/A of the words Correctly. How 
many words did' Jack misspell? 

o 80 • * 

-o A^ 

• ■ ^ o 15 
o A 



62.1 - Al.A 



o 40.7 
o 2817 
o 21.7 - 
o .57.06 

o None of these 
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Skill area 



fe. A p plicati on _ 



II.^EOMETRY 

'A. Knowledge of facts 



6. Application 



in. MEASUREMENT AND GRAPHS 



A. Knowledge of facts 



206^. 



ERIC 



Description of skills assessed 



The pupil must use the fo ur arithmetic 



operations on numbers In decimal form'to 
demonstrate understanding of principles 
and ability to solve problems in a daily 
life context. * * ♦ ' 



(Skills assessed in categories A and B 
in II. Geometry) 

The pupil must be able to identify basic 
geometric figures.' 



No. of 
Items 



The pupil must be able to comprehend and 
apply basic geometric knowledge and 
concepts. 



(Skills assessed in categories A and B 
in III,; Measurement and graphs) 

The pupil mu^t be able to estimate length 
and volume; convert length,; m^ss, volume, 
and time from one unit to another unit; 
periorm arithmetic operations on quantities 
of length, mass. Volume, and time.. 



(20) 



15 



(32) 



•14 



Average percent of questions 
answered correctly 



y 



1975-6 



55.8 



(58.8) 



68.7 



52.2 



<(52.1) 
44.8. 



.1976-7 



56.2 



(58.5) 



68.4 



51.9 



( 



(53.5) 



A7.2 



Change 



+0.4 



(-0.3) 



-0.3 



-0.3 



(+1.4). 



+2.4 



Illustrative test 'qi^stion 



The Wards' total expenses during the 8 
days at the ranch were $491.60. What 
was the average cost -per day? 

* o $61.45 

o $61.32 

o $60.20 

o Non^ qf Ehese 




This figure 
called a:- 

^ o pyramid 
o prism 
o c;yli'nder 
^ o cope 



Which' of the following figures is 
divided by a line of symetry? 





3 yards 1 foot / 



o 4 feet 
o 7 feet 
o 10 feet 
. o 13 feet 



2Q7 



Skill* area j 


Description of jkiUsi assesseji 


No. of 


Average 'percept ot 
answered corre 


questions 
ctly^ 




Items 


1975-6^,^ 




Change 


B. /Nppl^ication 


The pupil must be able to solve problems 
, related to measurement of length, area,^ 
ma%s,^ ifhd volume. 


18 


' 57.8 


58.4- 


+0,6 








- 








1 


\ 






* 




' ^ -i. 


* 




> 






\ 








• 


IV. PROBABILITY AND STATISTICS 

t 


(Skills assessed in categories A and B 
in IV.. Probability and Statistics) 


(12) 


(40.4) 


(40.9) 


• (-K).5) 


tZ^ A. Computation 
1 


The pupil must be a^jAe to compute 
probability of simo^e events and compete 
'the mean, mode, aflQ median of a set of 
given numbers. < 


6 


42.4 


42'. 3-'* 


' -O.l/ 
> 






• 








B. Applications^ ** 


The pupil must be^'able to solve problems 
related' to elementar5^ concepts in 
probabi^Uty and statistics. * f 


6 


38.5 . 


39.6 

♦ 


+1.1 


— ~* 


t 












• 


















• 





Illustrative test question^ 



HOW MANY FEET BEFORE YOU CAN STOf ^ *' . 




Use the above graph .to find the 
top safe* speed ^or stopping 
within a maximum distance of 



JAI^ feet. 



o 30 miles per houfc^ 
o 40 "miles perjhour' 
o 50 miles per'hoCir . « 
, o 120 miles per hour >^ ' 

t 

If an event is cettain t.o Cccur, th6n 
the probability of •that^'jtveat * is :< 

0 1/2^ ' . * ' 

0 1 

o 100 ' * 

f 

o zero 

/ 

A bowl contains one white marble, two 
red marbles, and three bli^e marbles. 
If you were blindfolded "^nd th«n re- 
moved ofte marble from the bowl, what is 
the probability that the marble you 
removed would be red? 

o zero y 
o 1/3 
o 1/2 
o 2/3 

o None of these 
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APPENDIX G 



Mathematics P^rfonnance, by Skill Area, of California 
Twelfth-Grade Students for 1975-76 and 1976-77 







Description of skills assessed 


No.' of 


Average percent of questions 
answered correctly \ > 


illustrative test quest iQn\ 




^ Skill area 


Items 


1975-6 


1976-7 


Chat/ge 

U 




TOTAL MATHE 


MATICS TEST J 
«* . 


^98) 


(67.0) 


(66.3)^ 


"1-0.7) 


; 




I. ARITffiiETIC 


(Skills assessed In categories A, B, C, 
and D in I. Arithmetic.) 


' (98^ 


(72.9) . 


(72.1) 


(-0.8) 


f 




A. Number concepts 


(Skills assessed in categories 1, 2, and 
3 in A. Number concepts.) 


(ZS) . 


(74.3) 


'.(73.5) 


(-0.8) 






I Number. and 
numeration 


The student must Identify whole numbers, 
fractions, and decimals, identify pUce 
value; and recognize points on a number 
line. 


14 


71.0 

•v 


70.1 ' 


-0.9 . 


In which numeral is the dlg^it 7 in the 
tens' place? - * ^ 

o 976.3 

o 97.63 I 

o"9.763 

o 0.9763 


• 


^ 2.^iumber theory 
• 


The stu5JeKt must recognize odd, even, 
prime, anil composite numbers and choose 
the lowe8t\:pinmon multiple or greatest 
cpmmon factor of several numbers. 


8 


76.2 

r' 


75.9 ' 
t 


-0..3 


If n is an odd number, what can you say 
^bout n + 1? ^ : 

o LO aiweiys oau . < 
4 o It is always even. 

o It is even or odd depending 

upon what ^ is, 
o None of these 




3. Number prppe^rties 

V 


The studetyc, must recognize cotBmitatiVe, 
associative,^ and distributive properties 
of operations on numbers. 

* 

i 


6 


79.6 


78.5 


-I. I 

% 


1 1 V 7 - /"A Y 7S + Y 7"^ 

1 1 A / — ^^HA / } ' ^JA t ) 

What number goes in the Q above? 
















o 2 

o 8 - * 
o 9 
o 20 




B. Whole numbers 


^Skills assessed in categories I and 2 
in B.. Whole Tnimbfcrs. ) 


* (22) , 


(80.1) 


(80.1) 


(-0-) ' 
1 


* 
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^ The values presented in this colunm are averages of t(e percents of questions answered correctly. The percentages for individual items vary from the 

Sverage value by 20 or more points. f ^ " , 

2 These sample.Jtest items are presented for illustrative purposes only; therefore, they do not cover all of the skills tested, nor do they necessarily 
possess all the qualitiels of good test items. 
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Skill area 



1. Computation 

2. Application 



C. Fractions 



I. Computation 



2, Application 



D. Decimals 



1. Computation 



ERLC 
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Description of skills assessed 



The student must perform addition, sub- 
traction,^ multiplication, and division 
involving whole numbers 



The student must apply the four arithmetic 
operations on who^e numbers in solving 
problems presented in a ddily ltf^^6ntext, 



(Skills assessed in categories 1 and 2 xn 
C. Fractions.) 

The student must perform addition, sub- " 
traction, multiplication, and divisiOTi i * 
involving fractional numbers.' , / 



The student must use the four arithmetic 
operations on fractions, mixed fractions^* 
or. whole numl^ers and fractions to demqn- 
strate compre'hens'ion or abdlity to solve 
problems in daily life context. 



(Skills assessed in categories 1 and 2 in 
D. Decimals.) 

The studerrt m^ist^perfonn addition, sub- 
traction; multiplication, and division 
involving decimal numlJers. 



4. 



No. trt 

Items 



14 



(2^6) 



14 



12 



(22) 



14 



Average percent of 
answered corre 


questions 

r.^ 1 «. 1 
Cl ly 


Illustrative test question^ 
\ 


1975-6 


. 1976-7 


Change 


80.9 


81.0- 


' +0. 1 


504 ' 


0 405/ ' 








-99 


\ 0 (»15 ' 










0 495 










' 0 505 


i 


f 
















% « 




78. 5 








78.7* ^ 


rO.2. 


A parking lot has 25 rows with 18 spaces 








for cars in each row. l£ 3 rows are 








• removed, for a driveway, what is the 






• 


greatest number of cars which can be 


• 






parked 


on the lot? 










0 375 










0 396 




. e 






0 A14 










0 447 


• 








0 None of these 


A 


t 


* 






(66.0^ ; 


w 


(-1.5V 






70.4 


68.3 


-2.1 


4 X 4/7 








> 


J 


0 1 2/7 










0 2 2/7f 










0 4 1/7- , 


\ 








•0 7 










60 9 ' 


An n 
DU > u 


rO.9 


J^ck' s 


spelling test has 60 words. ^ He 






• 


spelled 


3/4 of the words correctly. 








How many words did Jack misspell? 






- 




*♦ 

0- 80 


^. 








0 45 * 




- 






0 15* 






• 




0 4 


(Vl.8) ' 


v^(71.2) 


(-0.6) . 






M 7*4 1* 


73.8 


-0.3 


786.4 - 


34.87 = 
















- 




0 4-377 










0 43-77 • • 










0 751.53 










0 7,515.3 




































1 
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Skill area 



Description of skills assessed 



No. of 
Items 



Average percent of questions 
answered correctly^ 



75-6 



'1976-7 



Change 



Illustrative test question 



2 - 



1 Computation 



2. Application 



i 



C. Fractions 



1 Computation 



2. Application 



D. Decimals 



1. Computation 



214 




The student must perform addition, 
subtraction, multiplication^^ and division 
involving whole numbers. 



The student must apply the four arith- 
metic 'Operations on whole numbers in 
solving problems presented in a daily 
life context. 



(Skills assessed in categories 1 -n^d 2 
In C. Fractions.) 

The student must perform addition, 
subtraction, multiplication and division 
involving frairtional numbers. 



The student must^use the four arith- 
metic operations on fractions, mixed_ 
fractions, or whole numbers and fractions 
to demonstrate comprehension or ability 
to solve problems in 'daily life context. 

(Skills assessed in. categories 1 and 2 
in D. Decimals . ) * 

The student must perform addition, 
subtraction, mnTltiplication, and divisioji 
involving di&cimal, numbers.. 



14 



(26) 



14 



12 



(22) 



14 



80.9 



78.7 



(66.0) 



70.4 



{ 

60.9 
(?V.8) 
74.1 



81.0 



78.5 



(64.5) 



68.3 



60.0 



(71.2) V 



Z3.8 



I 

+0. 1 « 



-0.2 



<-1.5) 



-2.1 



-0.9 




-0.3 



504 
- 99 

o 405 

o 415 • ' 

o 495 » , ' 

o 505 

A parking lot has 25 rows wit^ 18 spaced 
for cars i^ each row. If 3 rows 'are 
removed for a driveway, what is the 
greatest number of cars which can, be 
parked on the lot? 

o 375 
^ o 396 ' 
V3 o 414 

o 447 

o None of these 



4.x 4/7 = 




Jack's spilling test has 60 words. He > 
spelled 3/4 of the words correctly. 
,How many words did Jack misspell? < 



786.4 - 34.87 
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Skill area 



\ 



Desdripcioa of skills assessed 
» 



^ 2, Application 



II. ALGEBRA 



A. Computation 



f,, B, Application 



III. ,OBCMETRY 

A. Knowledge of facts 

■ V 
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The student must use the four arith- 
metic t)peratlons on numbers In decimal ' 
form to demonstrate understanding of 
principles and ability to solve problems 
In dally life context. * 



(Skills assessed In cat^gorl^ A and B 
in II, Algebra.) 

The student niust be able to perform 
addition, subtraction*; multiplication, 
and division of jej^gebralc v ariab les and 
Identify a point sbown on rectangular 
coordinates. * 



The student must be able to c&B^truct an 
algebraic equation to solve a given 
problem and be able to Interpret tables, 
charts, and graphs. 



(Ski^s assessed In categories A and B 
In in. Geometry.) 

The student.must be able to Identify 
basic geometric sets and figures. 



No. -of* 
icems 



(32) 



14. 



18 



12 



..Average percent of questions 
afnswered correctly^ 



1975-6 ' 1976-7 . Change 



67.8 



(62.9) 



i 66.4 



60.1 



(62.7) 



75.2 



66. 



(62.1) 



65.9 



59.2 



(62.1) 
75.5 



-1.2 



(-0.8) 



-0.5 



-0.9 



1-0.6) 



^.3 



Illustrative test questioh^ 



If Betiiican drive 18.7 miles oil ^ach • 
gallon of gas, how many miles can she 
drive on 7 gallons? * » N 



o 126.9 
o 130.9 * 
o ^40. 9 
o 1309 

o None' of these ' 



If 7x - 38 = 18, th^n x* =_ 

o -8 ' ' 

o -5 • . 

« o zero ^ ^ • V 

o 5 ^ ' 

' o 8 ^ 

The following fbrrfula can dften be used 
to approximate'the weight for boys 
between the^ ages of 1 to 7; 

W = 8 + 2'2 A 

where W Is thi weight In-icilograms =and * 
A is the boy's age ln-y€^rs. The formula 
tells that for each year older that a"* < 
boy becomes, he should weigh r 



Q 8 kilograms more 
9.8 kilogi;;^ms lAs 
* 0*2.2 kilograms more 
o 2 . 2 ^kilograms less 



/ 




Which of the points are in the Interior 
of angle RST? 



o P only 

o V only 

O/V and W 

o R, S, and T - 
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'Skfll^lr 



*«rea 



Description of skills assessed- 



No. of 
Items 



Average percent of questions 
answered correctly 



1975-6 



1976-7 



Change 



Illustrative test question 



B. Application 



The student must be able to comprehend 
and apply basic geometric knowledge and 
concepts. ^ 



12 



50.1 



48.7 



-1.4 



IV. llEAslREMflNT / 

' A. Knowledge of facts 



r 



(Skills assessed 'In categories A and B , 
In IV. Measurement.) ^ ^ 

THe .student must b^ able to estimate* 
length p^nd illume; convert lengthy mAS8» 
volume » ana time from one unit to another 
unit; and perfonn arithmetic operations 
on /Quantities 6t length, diass^ vollime»i 
and time, * - 



B. Application ^ s \ 




rel 
masd 



.tudent must be^Ale to solve problems 
:ed to measurement of length ar^a» 
and volume*.' — 



I 



.v.. PROBABILm\ AND STATISTICS 
^ A. Computation' 



(Sk\lls jisseased in categorie« A and, B in* 
V./ Probablllrty and Statlstlps.) ^ 

The student must be able to compute the ' 
t/robablllty of« simple events and compute 
The mean» md^e» and median of a set of 
given numbers. 



V ERIC/ 



■ W 



(30), 



12 



18 



(14) 



(60.5). 



71.6 



(59.5) 



70.5 



53(1 



52.2 



(57.2) 



57.9 



(56.9) 



57.6 



In the plane of a circle with radius 

5.04 Inches » if a point P lies 5.4 

Inches from the center of the circle, 
then P lies-: 

o on the circle 

,0 at the center of the circle ^ 
' o Ou^tslde the circle* 
o inside the circle but not at 
the center 



(-1.0) 



■1.1 



^0/9 



(-0.3) 
-0.3 



10 decimetres 
1000 millimetres 



1 metre 
1 meJgire 



The length of a piece of chalk is 0.5 
decimetre. What is its length in 
millimetx^es? 

0-0.05 ♦ * 
o 5 
o 50 
o 500 

X housewife wilU pay the lowest price, 
per ounce for rice if she buys it at the 
store whiCinKfers : 

o 12 oun6e8 'for 40 cents 
o 14 ounces for 45 cents 
o 1 pound, 12 ounces for 85 cents 
o 2 pounds for 99 cents 
« o None of these 



\1 ' 

HarV lin 



Tom, Dick/ and HarV lined up to enter 
their classroom. What is the probability 
that Tom was the first ona in lin«J 

'o zero 

o 1/3 ^ 

o 2/3 . ' . ' ' 

o L • * 

o None of these 
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Skill area 



Description of skills assessed 



. B. Application 



The student muat be able to solve 
problema related to elementary concepts* 
in probability and statistics. 



' 220 



ERiC 



No^. of 
Items 



Average percent of questions 
answered correctly^ 



1975-6 



1976^7 



Change 



Illustrative test question^ 



56.6 



-0.3 



Three of four boys each weighs 60 pounds 
What is the weight of the fourth boy if 
the average of the weights of all four 
boy^ is 70 pounds? « 

o 130 pounds 
o 100 pounds 
o '80 pounds 
o 65 pounds 
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APPENDIX E • 

*A Description of Equating Procedures Used* 
in the California Assessment Program 

Grade Three 

School-leve^ frequency distributions of the' total reading score from the Spring, 
1977 administration of the Comprehensive Tests of Bagic Skills , Fojm S, Level 1, 
were obtained from 11 districts: Fountain Valley, Fullerton, Santee, Pomona, 
Compton, South San Francisco, Redwood City, Salina City, Ukiah, Berkeley, and 
Ceres* For each school, the number of students tested on the CTBS and the num- 
ber tested on the Reading Test , Sjpring, 1977 administration, were compared. 
Wh6n the difference in the ftumber of pugils tested. exceeded 10 percent', the 
school was eliminated. Nineteen schools wer^ eliminated for that reason. They 
were replaced by 19 schools from San Jose Unified. The total final sample , included 
138 schools, with 8,699 pupils tested on the CTBS, and 8,589 tested on the Reading 
Test, .after scores of non-E^lish speaking, pupils had been eliminated.; 

The frequencV distribution for the 8,699 CTBS scores was totalled. The scores of 
the 8,589 Ivipils tested on the Reading Test were used to estimate what the mean 
and variance of total test scores would have been had all students take^ the full 
250-ltem Reading Test > ^ The obtained mean and variance were used to estimate what 
the distribution of scores would have been had all students taken the total te^t . 
by assuming that, those ^total test scorers would have distributed themselves a 
negative hypergeometric distribution. 

The ^o frequency distributions— the actual obtained one for the CTB^and the 
estimated, one for the Reading Test — were used to develop an equipercentile equating'^ 
line. This is^done by taking any point in one distribution,. computing the percent • 
of scores lyin^ below that point in the distribution,, and then finding the point 
in the second distribution that lias that same percent of scpres lying below it. 

The distributions of scores that would have occurred had all, pupils in California 
taken the full 250-item Reading Test ^ rather than a 25 intern sample were estimated 
for grades two and three. At both grades, this was done by first computing the • 
estimated total-test jyariance from* a 2 percent systematic sample of all pupils 
•tested. Again assuming th^t spores statewide followed a negative, hypergeometric 

distribution, the stople variance and population mean then were used to estimate ^ 

the statewide distribution ^of scores. . ' . , 

Ffom these two distributions,^ it was estimated that if all, pupils in the state 
had taken the full 250-item Reading Test in I9?7, the median score for gr.ade two 
would haVe been 182.0, and for grade three, 221.0. From- the equating line, 
^these scores equated to CTBS total reading scores of 33 and 53, respectively^ * 
A total reading score of 33 on the CTBS at. the second grade is the 55th percentile; 
A score of '53 at the third grade is the 56th percentile.^ 



Grade Six 



\ 
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Equating for gtade six was done in a manner very similar to that for grade three. 
DistHct-level frequency distributions for the total reading, total language, * 
and total matheiiiatics scores from the Spring, 1977 administration of the Com- 
prehensive Teats of ' Basic glkilts . Form S, Level 2, w^re obtained from seven 
districts: South San Francisco, Turlock, Santee, San,4ose, Uklah, Ceres, and 
Fountain Valley These seven districts were chosen because they had administered 
the CTBS to theij^ entire siocth grade population.' This was verified against the 
«mber tested on the Survey of Basic Skills; Grade 6 > . The total sample included 
6,876, 6,830, and 6,845' students tested on the CTBS jLnvreading , language, and 
math, respectively,' and 6,753 students tested on the SBS^ ' ^ 

Equipercentile equating ^lipes were developed for all three areas using the same 
procedures developed for grade three. The statewide .variance was estimated from 
ai one-thirtieth systematic sample of the state. Then, the statewide median was 
estimated, by content area, for the total SBS by assuming scores, followed a 
negative hypergeoinetric distribution with the population mean and estimated 

^population variance. The estimated median scores on the SBS were 88.3 (out of 
128 items) for reading, ^84.1 (out of 128 Itans) fox written expression, and 93.5 
(out of 160 items), for mathematics. These equated tc^ CTBS raw scores, of 63, 79, 
and 74 for tptal reading, total' language, \ and total mathematics, respectively. 

^ The corresponding publisher percentile ranks of these scores were 53, 51, and 51. 

Grade twelve * , ^ 

Prior to 1974-75, Calif oynia^'twelfth-grade students had been fes ted with the 
Iowa-Test s of Educational .Development. In January of 1975, the new state- 
developed test. Survey of Basic Skills; Qrade 12 > was introduced. In sprinJ, 
1975, a special study was conducted to estimate what ^he statewide performance 
of California twelfth-grade students "would be if they had taken one of the three ' 
standardized tests in January, 1975: Iowa Tests of Educational Development (ITED) , 
Sequential Tests of Ed ucational Progress (STEP Series II); and the Tests ef Academic 
Progress (TAP). Using the estimated performance on the publishets' tests and the 
data .from' the administration of the new atate-developed tests, estimates of 
California? student performances in comparison to national norms were/also ob- 
tained for 1975-76 and 1976-77. • 

Estimation of National Norm Comparisons for> 1974-75 . Data from the following ' • 

samples of students were used for estimating ^ the performance of the staters median ' 

student on selected standardized tests: (1) ^jkpercen^f random sample of 25,000 
^tudent8_drawn_.from tbe entire st at;e populatii^K^ t welfth- graders, with gcorea 
the Survey of Basic Skills; ' Grade- 12 . and (^K stratified random sample o^ 

105 schools with about 30,000 gradf-twelve stucfStsi. All grade- twelve^ students 
, in each of the schools in the stratified sample v^ere administered one part (cohtent . 

area) of the following standardized tests. In the spring of 1975: ITED Reading, 
^ ^Language, or Mathanatica; STEP . Series II, Reading, English .Expression, or 'Math- 
, ematics; TAP Reading, Composition, or Mathematics. The data on these students were 

also available from the -January, 1975 statewide administration of the grade-twelve 
> Survey . By matching students within a sthool on the basis of their birthday and- ^ 

sex, the data .from the standardized tests wer^ paired with that of the Survey ^ 

Approximately 15,Q00 students comprised the matched sample. 
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The procedure 'for estimating the^perf ormahce of -the median California student 
as compared to publishers' norms included, the following steps. 

1. Linear Equating of the Survey Forms ^ , The total number of items in the 
, Survey were spread over 18 forms in a stratified random sampling fashic^n. 
/ Each form had an approximately equal number of items in the^ three content . 
areas: reading, written expression, and mathematics. Since items were ^ 
not exactly equal in each form and since the difficulty value of the item 
• cluster jwithin each content area varied from fbrm to form a linear equating 
» procedure was used to convert the raw scores to a common scale scores, o For 
eaclC^Sntent area the raw scores on .17 forms were equated to the scale 

of .the chosen form. The transformation equation took the following 



^ ' Y « aX + b ^ 

where, a = -r^r- and t -Y - aX. 

SD r ^ 

A • 
0 ft 

♦ 

2. Estimation of Median Student -Performance . The performance of the state'^ 
twelfth-grade median^ student on each of the nine standardized tests (three 
^ t-ests by three content areas) was estimated by means of a frequency estimation 
pi;ocedure^. The purpose of the;.' frequency estimation ptocedure was to estimate 
. . a marginal frequency distribution for each standardized test, given only to a ^ 
smaller group, using the bivariate distribution of the standardized test with 
the Survey given to. the same amall group, and the i^nivariate distribution of ^ 
the Survey given to a larger group. The marginal frequency distribution of' 
the standardized test^gave the estimated distribution that would have resulted 
if all Calif ornia twelfth-graders had taken the standardized test. The raw 
score corresponding to the median of the estimated distribution representefl 
the performance of the mediian student on the standardized test". * The estimated 
raw score was , then converted to the percentile ranking corresponding to the 
publisher's norm sample. The statewide performance^ on the three standardized 
t^e^sts in the three content areas, — reading, written expr,essipn,' and mathematics — 

. -ar^. given in Table 35. ' / ' , 

Estimation of National Norm Comparisons for 1975-76 . The student performance in 
1975-76 on publisher's test was estimated by assuming that the z~score change from 
1974-75 to 1975-76 , on the 9 tandardized test would be equal to the observed Z'^sco^e 
Change during the same two years on the Survey . Furthermore, it was assumed that 
the performance on the typical Califxi^nia twelfth-grade studexut was represented 
by the, mean statistic b^kn on the standardized test and on the Survey . In 
particular, .tlife. following equation-^was used to calculate the performance of the 
twelfth-grade students in 1975-76 on the standardized test in raw score unit: 



■ m 



1 J ^ • . 

For details of frequency estimation procedure, see Bianchini, J.*C. , "Estimation 

of California Statewide Performance on Selected Standardized Tests at Grades 

6 and 12," ETS, Berkeley, California, 1975. 
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. where 9 



Y + ^ (X' - X) ' 

^°X f 




Y' « Estimated raw score on the standardized^test in 1975-76 
Y « Mean raw score on the standardized test. in the year 1974-75 

X' » Mean Survey score on common items in 1975-76 
X « Mean Survey score on common'items in X974-75 
SD « Standard deviation of the student scores reported by the 
publisher 

SD' « Estimated standard deviation of the student scores on ♦ 
^ " the Survey • , ^ 

The standard deviation of the student scores on the Survey was estimated using 
the following relationship. 

Standard deviation of the district Standard deviation of the district 

.scores on the Survey . ^ , ^ scores on th^ ITED 

Standard deviation of the student Standard deviation of the student 

^ scores on the Suryey - • ' scores on the; ITED . ^ 

The Standard deviartions of the student and distric't sqores on ITED were aVailable 
from the statewide testing program data for 1973-74. The standard deviation of 
the district scores on the Survey was calculated from the data available from the 
1975-76 administratioil of the Sur.vey . 

The percehtile ratik corresponding to the estimated mean on the, staildardized test, 
Y*, was obt^ned using the test publisher'a norm table. TJie percentile ranks were 
linearly .interpolated from the norm table, i^ necessary, to find the percentile 
ranking corresponding to a -fractional raw score. Table 35 provides the estimated 
performance of California twelfth-grade students for 1975-76. 

Estimation of National Norm Comparison for 1976-77» The estimation procedure 
for 1976-77 was the same as the procedure for 1^75-76 except that in the 1976-77 
estimation, the values of X and X* were based upon all item data because the " 
tests for the two years were exactly the same. Table 35 provides the estimated 
performance of California twelfth-grade students for 1976-77. 
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